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Abstract 

Nowadays, modern complex systems of any interdisciplinary nature can hardly be analyzed and/or modeled without 
comprehensive usage of system theoretic approach. The complexity and uncertainty of the nature of modern systems, and 
the heterogeneity of related information, require a complex approach for their study, based on systems theory and 
systems analysis and consisting of information and expert knowledge management, initial pre-processing, modeling, 
simulation, and decision making support. As the complexity of systems increases, system theoretic methods become 
more crucial. Often they may provide the only effective tools to obtain the information about the elements in a system, 
connections between those elements, and a means for getting the adequate representation of system in a whole. The 
variety of complex systems can be described by deterministic or stochastic differential equations, statistical mechanics 
equations, neural network models, cellular automata, finite state machines, multi-agent systems, etc. Most of the complex 
real world objects are modeled as dynamic systems enriched by artificial intelligence resources. Equipped with artificial 
intelligence techniques, these models offer a wide variety of advantages such that coping with incomplete information 
and uncertainty, predicting system's behavior, reasoning on qualitative level, knowledge representation and modeling, 
where computer simulations and information systems play an important and active role and facilitate the process of 
decision making. 

This chapter aims to discuss the problems of modeling, control, and decision support in complex dynamic systems 
from a general system theoretic point of view, with special emphasis on methodological aspects. We consider the main 
characteristics of complex systems and of system approach to complex system study. Then the chapter continues with the 
general dynamic modeling and simulation technique for complex hierarchical systems functioning in control loop. The 
proposed technique is based on the information-mathematical models and described in terms of the hierarchical state 
transition diagrams. The methodology is sufficiently abstract to allow both qualitative and quantitative analysis of system 
state dynamics and control through hierarchical scenario calculus. The evaluation of different scenarios is defined by the 
multiple criteria vector-functions related to the efficiency of control strategies and time required for system goals 
achievement. We also offer general architectural and structural models of computer information system intended for 
simulation and decision support in complex systems. 
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1. Introduction 

Complex System Sciences, as a field of research, has emerged in the past two decades. It is a 
multidisciplinary field aiming at understanding the complex phenomena of the real world that 
surrounds us. It studies how parts of a system give rise to the collective behaviors of the system and 
how the system interacts with its environment [1,2]. 

The field of complex systems cuts across all traditional disciplines of science as well as physics, 
mathematics, biology, engineering, management, and medicine. It focuses on certain questions about 
parts, wholes and relationships. These questions are relevant to all traditional fields. Examples of 
complex systems are neural networks in the brain that produce intelligence and consciousness, 
artificial intelligence systems, swarm of software agents, social insect (animal) colonies, ecological 
and biological systems, traffic patterns, robotic systems, social and economic systems and many 
other scientific areas can be considered to fall into the realm of complex systems. 

Complex systems are usually understood intuitively as a phenomenon consisting of a large 
number of elements organized in a multilevel hierarchical structure [3, 4], where elements 
themselves could represent systems (the concept "system of systems") [1]. The term complex is used 
to point out the fact that the problem treated here cannot be expressed only in quantitative relations 
but instead the most relevant values are qualitative. 

So, the first and main characteristic of complex systems is that they contain a large number of 
mutually interacting entities (components, agents, processes, etc.) whose aggregate activity is 
nonlinear, cannot be derived from the direct summations of the activity of individual entities, and 
typically exhibit a some sort of self-organization (for example, hierarchical) [5-7]. Another important 
characteristic of complex systems is that the description of complex systems requires the notion of 
purpose, since the systems are generally purposive [2]. This means that the dynamics of the system 
has a definable objective or function. Each element of a complex system interacts with other 
elements, directly or indirectly. The actions of or changes in one element affect other elements. This 
makes the overall behavior of the system very hard to deduce from and/or to track in terms of the 
behavior of its parts. This occurs when there are many parts, and/or when there are many interactions 
between the parts. Since the behavior of the system depends on the elements interactions, an 
integrative system theoretic (top-down) approach seems more promising, as opposed to a 
reductionist (bottom-up) one. 

Any scientific method (approach, technique) of studying complex real world systems relies on 
modeling (analytical, numerical) and computer simulation [10]. The study of complex systems 
begins from a set of models that capture aspects of the dynamics of simple or complex systems. Most 
of the complex real world objects are modeled as dynamic systems [11]. These systems can be 
described by deterministic or stochastic differential equations, neural network models, cellular 
automata, finite state machines, multi-agent systems, etc. Most of the complex systems can be 
studied by using nonlinear mathematical models, statistical methods and computer modeling 
approaches. These models should be sufficiently general to encompass a wide range of possibilities 
but have sufficient structure to capture interesting features [12]. There are three interrelated 
approaches to the modern study of complex systems: (1) how interactions give rise to patterns of 
behavior, (2) understanding the ways of describing complex systems, and (3) the process of 
formation of complex systems through pattern formation and evolution. 
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But the final intention in the study of complex systems is to understand the real nature of the 
processes, their dynamics, their influence and interconnections, and the possible outcomes in order to 
make preventive actions and to make correct decisions. It also facilitates taking composite decisions, 
which are often the only possible ones in case of complex systems. 

Moreover, as a rule, modern complex systems are large-scale. Large-scale systems are typically 
imposed a hierarchical structure in order to manage complexity. In hierarchical models, the notion of 
consistency is much important, as it ensures the implementation of high-level objectives by the lower 
level systems [3, 4, 8, 9, 12]. Such a description of system depends largely on the problem domain, 
specific goals and the point of view of the researcher. Although the problem of a researcher/decision 
maker as an active element of the system has been considered in the literature to date, there is no 
unique opinion on the influence of the observer in the process of modeling. 

Although many efforts have been made, there is no commonly accepted definition of a complex 
system. Heuristic approaches basically focus on the interaction between (microscopic) subsystems 
and the emergence of new qualities at the (macroscopic) system level, e.g. 

• Complex systems are systems with multiple interacting components whose behavior cannot 
be simply inferred from the behavior of the components. - New England Complex Systems 
Institute 

• By complex system, it is meant a system comprised of a (usually large) number of (usually 
strongly) interacting entities, processes, or agents, the understanding of which requires the 
development, or the use of, new scientific tools, nonlinear models, out of equilibrium 
descriptions and computer simulations. - Journal Advances in Complex Systems 

Nevertheless, whatever definition one relies on, any complex system is a system with numerous 
components and interconnections, interactions or interdependencies which are difficult to describe, 
understand, predict, manage, design, and/or change [2, 12]. 

For this reason, computer simulations play a crucial role in studying complex systems and in 
understanding of how these systems function and work, and how they could be efficiently controlled. 
Nowadays, information technologies and computer simulations have evolved into an essential tool 
for modelling, assessment and support in any domain requiring decision making. The complexity and 
uncertainty of the nature of complex systems, and the heterogeneity of related information, require a 
complex approach for their study, based on and consisting of data and knowledge management, 
modelling, simulation and, lastly, decision making support [13-15]. So, the search for the ways for 
formalization and automation of processes of modeling, control, and decision support in complex 
systems continue to attract much attention. 

This chapter aims to discuss the problems of modeling, control, and decision support in complex 
dynamic systems from a general system theoretic point of view, with special emphasis on 
methodological aspects. We consider the main characteristics of complex systems and of system 
approach to complex systems study. The chapter continues with the general dynamic modeling and 
simulation technique for complex hierarchical systems consisting of many objects and functioning in 
control loop. The proposed technique is based on the information-mathematical models and is 
described in terms of the hierarchical state transition diagrams. The methodology is sufficiently 
abstract to allow both qualitative and quantitative analysis of system functioning and state dynamics 
through hierarchical scenario calculus. The evaluation of different scenarios is defined by the 
multiple criteria vector-functions related to the efficiency of control strategies and time required for 
system goals achievement. We also offer a general structure of computer information system 
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intended for simulation and analysis of dynamic processes, control strategies and development 
scenarios in complex systems, and a structural scheme of decision support process. 

The chapter is organized as follows. The next section presents the principles of system approach 
to complex systems study and the basic features of complex systems. The problem of modeling and 
control within the context of complexity of modern systems is addressed in section 3. The section 4 
is devoted to the analysis of known existing paradigms and methods of mathematical modeling and 
simulation of complex systems, which support the processes of control and decision making. In 
section 5 we present a method of hierarchical state diagrams as a tool of dynamic modeling and 
simulation of complex hierarchical systems; we give conceptual principles of agent -based parametric 
modeling and then we describe the method in much detail. Then we outline some possible directions 
of further development of the proposed technique. The architecture of information system that 
supports simulation and analysis of dynamics processes and control scenarios, and decision making 
in complex hierarchical systems is proposed in section 6. In conclusion we make some final remarks 
on the topic of this chapter, and outline the areas of application of the presented technique. 

2. System Theoretic Approach for Complex Systems Study 

The majority of real-life problems can be classified as complex ones, and, as a result, they inhabit 
some particular characteristics, which require interdisciplinary approaches for their study. A system 
is an integration of interconnected parts and components (through informational, physical, 
mechanical, energetic exchange, etc.), which result in emerging of new properties, and interact with 
the environment as a whole entity. If any part is being extracted from the system, it looses its 
particular characteristics, and converts into an array of components or assemblies. An effective 
approach to complex system study has to follow the principles of the system analysis [16-20], which 
are: 

1 . Description of the system. Identification of its main properties and parameters; 

2. Study of interconnections amongst parts of the system, which include informational, physical, 
dynamical, temporal interactions, as well as the functionality of the parts within the system; 

3. Study of the system interactions with the environment, in other words, with other systems, 
nature, etc.; 

4. System decomposition and partitioning. Decomposition supposes the extraction of series of 
system parts, and partitioning suggests the extraction of parallel system parts. These methods 
can be based on cluster analysis (iterative process of integration of system elements into 
groups) or content analysis (system division into parts, based on physical partitioning or 
function analysis); 

5. Study of each subsystem or system part, utilizing optimal corresponding tools 
(multidisciplinary approaches, problem-solving methods, expert advice, knowledge discovery 
tools, etc.); 

6. Integration of the results received from the previous stage, and obtaining a pooled fused 
knowledge about the system. The synthesis of knowledge and composition of a whole model 
of the system can include formal methods for design, multi-criteria methods of optimization, 
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decision-based and hierarchical design, artificial intelligence approaches, case-based 
reasoning, and others such as hybrid methods. 
Basic reasons that make it difficult for complex systems to be described by formalized methods 
are the following ones: 

• Information incompleteness on the state and the behavior of a complex system; 

• Presence of a human (observer, researcher) as an intelligent subsystem that forms 
requirements and makes decisions in complex systems; 

• Uncertainty (inconsistency, antagonism) and multiplicity of the purposes of a complex 
system, which are not given in a precise formulation; 

• Restrictions imposed on the purposes (controls, behavior, final results) externally and/or 
internally in relation to a system are often unknown; 

• Weak structuredness, uniqueness, combination of individual behaviors with collective ones 
are the intrinsic features of complex systems. 

Complex systems are different from simple systems by their capabilities of: 

• Self-organization - the ability of a complex system to autonomously change own behavior 
and structure in response to events and to environmental changes that affect the behavior. 

For systems with a network structure, including hierarchical one, self-organization can amount 
to: (1) disconnecting certain constituent nodes from the system, (2) connecting previously 
disconnected nodes to the same or to other nodes, (3) acquiring new nodes, (4) discarding 
existing nodes, (5) acquiring new links, (6) discarding existing links, (7) removing or modifying 
existing links. 

• Co-evolution - the ability of a complex system to autonomously change its behavior and 
structure in response to changes in the system environment and in turn to cause changes in 
the environment by its new (corrected) behavior. 

Complex systems co-evolve with their environments: they are affected by the environment and 
they affect their environment. 

• Emergence - the property that emerge from the interaction of constituent components of a 
complex system. 

The emergent properties do not exist in the components and because they emerge from the 
unpredictable interaction of components they cannot be planned or designed. 

• Adaptation - the ability of a complex system to autonomously adjust its behavior in response 
to the occurrence of events that affect its operation. 

Complex systems should adapt quickly to unforeseen changes and/or unexpected events in the 
environment. Adaptation enables the system to modify itself and to revive in changing 
environment. 

• Anticipation - the ability of a system to predict changes in the environment to cope with 
them, and adjust accordingly. 

Anticipation prepares the system for changes before these occur and helps the system to adapt 
without it being perturbed. 

• Robustness - the ability of a system to continue its functions in the face of perturbations. 
Robustness allows the system to withstand perturbations and to keep its function and/or follow 
purposes, giving the system the possibility to adapt. 
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Being oriented on the analysis of complex object as a whole, the system approach does include 
the methods of decomposition of complex system on separate subsystems. But the main purpose is 
the subsequent synthesis of subsystems, which provides the priority of a whole. However, reaching 
this priority is not simple. For a number of complex systems, optimum of the whole system cannot 
be obtained from optimums of its subsystems. It should be noted, that complex systems that possess 
the property of integrity do not have constituent elements and act as one whole object. In this kind of 
systems, the connections and relations are so complicated and strong (all-to-all) that they cannot be 
considered as an interaction between the localized parts of system. In physical systems the integrity 
corresponds to locality that is to such an influence of one part of system to another which cannot be 
explained by interaction between them. As a rule, connections in integrative systems are often based 
on structural principles, but not on the cause/effect principle. 

3. Complexity, Modeling, and Control in Complex Systems 

Complex systems are more often understood as dynamical systems with complex, unpredictable 
behavior. Multidimensional systems, nonlinear systems or systems with chaotic behavior, adaptive 
systems, modern control systems, and also the systems, which dynamics depend on or determined by 
human being(s), are the formal examples of complex systems [21-23, 26, 27]. In connection with 
modeling and control complexity, complex systems have specific characteristics, among which are: 

• uniqueness; 

• weak structuredness of knowledge about the system; 

• the composite nature of system; 

• heterogeneity of elements composing the system; 

• the ambiguity of factors affecting the system; 

• multivariation of system behavior; 

• multicriteria nature of estimations of system's properties; and, as a rule, 

• high dimensionality of the system. 

Under such conditions, the key problem of complex systems and control theory consists in the 
development of methods of qualitative analysis of the dynamics of such systems and in the 
construction of efficient control techniques. In a general case, the purpose of control is to bring the 
system to a point of its phase space which corresponds to maximal or minimal value of the chosen 
efficiency criterion. Another one of the main and actual problems in the theory of complex systems 
and control sciences is a solution of "ill-posed, weakly- and poorly-structured and weakly- 
formalizable complex problems" associated with complex technical, organizational, social, 
economic, cognitive and many other objects, and with the perspectives of their evolution. Since the 
analysis and efficient control are impossible without a formal model of the system, the technologies 
for building of models of complex systems have to be used. 

Complexity of a system is a property stipulated by an internal law of the system that defines 
some important parameters, including spatial structure and properties of the processes in this 
structure. This definition of complexity is understood as certain physical characteristic of nature. 
Since it is a nonlinearity of internal regularities (laws) that underlies the complexity of real world 
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systems, complexity and nonlinearity are sometimes considered as synonyms. And the more complex 
a process or geometrical form of a system (or object), the more it is nonlinear. 

Complexity is also a many-faceted concept. Today we can distinguish several basic forms of 
complexity: structural, geometrical, topological, dynamical, hierarchical, and algorithmic. However, 
other possible forms of complexity can be found as well. For example, one that comes from large 
scales. 

Large-scale control systems typically possess a hierarchical architecture in order to manage 
complexity. Higher levels of the hierarchy utilize coarser model of the system, resulting from 
aggregating the detailed lower level models. In this layered control paradigm, the notion of 
hierarchical consistency is important, as it ensures the implementation of high-level objectives by the 
lower level system [29, 30]. Large-scale systems are systems of very high complexity. Complexity is 
typically reduced by imposing a hierarchical structure on the system architecture [3, 4, 6-9, 12]. 
Hierarchical structures for discrete event systems have been considered in multiple works [30-33]. In 
such a structure, systems of higher functionality reside at higher levels of the hierarchy and are 
therefore unaware of unnecessary lower-level details. One of the main challenges in hierarchical 
systems is the extraction of a hierarchy of models at various levels of abstraction which are 
compatible with the functionality and objectives of each layer. The notions of abstraction or 
aggregation refer to grouping the system states or control objects into equivalence classes [30]. 

Algorithmic complexity finds itself in many software systems. These are the most complex 
systems developed by human being, although their structure and dynamics are comparatively simple. 
Structural, dynamical, algorithmic, hierarchical and large-scale complexity of systems attracts much 
of attention because we face them, manifestations of nonlinearity of nature, in our everyday life. 

Interplay between intellectualized mathematical and information technologies of control and 
decision support plays an important role in modeling of processes of evolution and functioning of 
complex systems. Intellectualization of complex control systems is being actively developed in the 
last decade. In order to intellectualize modern control systems the artificial intelligence methods or 
intelligent subsystems embedded in control system are more often applied [34, 35, 46, 104]. The 
intellectualization of complex systems seems to be a positive and very perspective direction of 
control systems development. It significantly eases control decision making, as the underlying 
mechanisms are similar to those used by human intellect. Control processes in intellectualized 
systems are based on the experience, skills and knowledge, that is, they are mostly based on the 
"understanding" of complex situations of purposeful behavior. An elementary intellect in control 
systems is constructed by using feedback loops and information flows, which give a system the 
capability of "understanding" of current situations. To "understand" the more complex situations, an 
adaptive subsystem should be added to the main feedback loop. However, if the object/system 
performs multiple functions (multipurpose object) then each function makes the system more 
complex and, as a consequence, the more sophisticated intelligent subsystems have to be used. But 
many questions remain: how to differ control systems by the level of intelligence; at what level of 
evolution of control systems they can be considered as artificial intelligence systems; what is the 
relation between adaptive properties and intelligent systems? 

For modeling and analysis of complex control systems in the presence of principally non- 
formalizable problems and impossibility of strict mathematical formulation of problems, expert 
knowledge and information databases are used. Construction of models of complex systems is 
accompanied by extensive use of expert knowledge and information about the system stored in data- 
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and information systems. This knowledge should be integrated in a unified way. Qualitative 
character of most of the parameters of complex systems results in knowledge fuzziness and 
uncertainty and, as a consequence, in problem of its formalization. 

The said above supports the fact that complex systems are usually difficult to model, design, and 
control. There are several particular methods for coping with complexity and building complex 
systems. At the beginning, a conceptual model of system is developed, which reflects the most 
important, in the context of the problem under study, material and energy and information processes 
taking place between different elements of system (or, subsystems), internal states of which can be 
considered as independent. This kind of model determines the general structure of system and it 
should be complemented by algorithmic and, more often, by mathematical models of each of 
subsystems. These models can be represented by graph models, Petri nets models, system dynamics 
models or by their combination. The obtained models are aggregative that reflect the dynamics of the 
most important, for the current investigation, variables. Then, the next step consists in checking the 
mathematical models for their behavioral adequacy to real system, and in identification of parameters 
of the models over the sets of admissible external actions and initial/boundary conditions. The 
difficulties of solution of these problems increase as the system becomes more complex. For this 
reason, another important step is structuring of problem domain (or situations), control domain, and 
simulation scenarios. For these purposes, stratified models, state (or flow) diagrams models, system 
dynamics models, aggregative models and robust identification can be used. However, the developed 
model should be subjected to intense analysis and possible changes after its testing for structural 
controllability, observability, identifiability, and sensitivity. These properties guarantee the model 
crudity in a given class of variations of the problem conditions and, as a consequence, the reliability 
and accuracy of system simulation. Besides that, the crudity enables one to reduce the model to 
canonical (more simple) forms which leads to significant simplification of modeling, control 
synthesis, and analysis of the system. Thus, when constructing a model of complex dynamical 
system, three forms of its description arise: (1) conceptual model, (2) formalized model, (3) 
mathematical model, and (4) computer model. 

4. Mathematical and Simulation Modeling of Complex Dynamic Systems: 
Existing Frameworks and Paradigms 

The system approach assumes that any object under study is considered as a single complex 
system together with the control subsystems. To ensure high quality management one should be 
familiar with the properties of controlled subsystems. In order to identify the properties of controlled 
subsystems, as well as to evaluate the quality of decisions, their responses to applied decisions and 
activities, and the results of automated modeling of the subsystems in different predictable conditions 
should be used in the process of functioning of the object. 

In systems simulation there are several paradigms, formulations of problems, and approaches to 
their solution, which are used as a "framework" for building and analyzing models. There are several 
quite different viewpoints on system modeling: dynamical systems, system dynamics, discrete event 
systems, cellular automata models, neural network models, finite state machines, cognitive modeling 
(cognitive maps), and multi-agent models. These paradigms differ, rather, by concepts and views on 
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the problems and approaches to solving them, than the applications areas. Often, the adherents of a 
paradigm believe that the right formulation and solution of problems of modeling and simulation can 
only be possible within the framework of concepts and techniques of this particular paradigm. For 
example, the advocates of modeling and analysis of dynamical systems believe that other approaches 
are "not entirely" scientific, or they are just special cases of system representation and analysis as 
systems of algebraic differential and/or integral equations. In fact, each of the paradigms has their 
own right for a life, and their use is determined only by the aims of modeling and is associated with 
those aims by means of the chosen level of abstraction for solving (control) problems. 

4.1. Aggregative Models of Systems 

Aggregative model describes the control object as a multilevel structure of dynamical systems of 
given types or as aggregates [38]. In this description, the system is viewed as a synthesis (the most 
general and most complex) of a generalizing class of complex systems, and is called aggregative 
system [38-40]. The aggregate is used to model the elementary blocks of complex system. So, 
aggregative system is a system composed of any set of aggregates, if the transmission of information 
between them is instantaneous and without distortion. 

Let T c R be a subset of real numbers, X, U, Y, Z be sets of any nature. The elements of these sets 
are interpreted as follows: t G T is a time instant, x G X is an input signal, u G U is a control symbol 
(signal), y G Y is an output signal, z G Z is a state. States, input, control, and output signals are 
considered as functions of time, z(t), x(t), u(t), and y(t). Formally, aggregate is a mathematical 
model represented by the tuple 

A = {T,X, U,Y,Z,H,Q} 

where H and Q are operators (in general case, random ones); H is a transition operator, which 
defines the current state on the basis of previous states (history); Q is an output operator. These 
operators realize the functions z(t) and y(t). In general, all sequences of events in the aggregate are 
realizations of random sequences with the given distribution laws. The structure of these operators 
distinguishes the aggregates amongst any other systems. 

As a rule, it is always possible to distinguish two types of states: (1) ordinary states in which the 
system remains almost all the time, (2) special states, specific to the system in some isolated time 
instants, coinciding with the receipt of input and control signals or with the issuance of the output 
signal; at these moments the aggregate may change its state discontinuously, but between the special 
states the change of the coordinates occurs smoothly and continuously. 

The aggregate is a mathematical scheme of quite a general type, special cases of which are 
Boolean algebras, contact relay networks, finite automata, dynamical systems, described by ordinary 
differential equations, and some other mathematical objects. 

The model of aggregate can be used as a model for a discrete-continuous system (hybrid system) 
in a whole or as a basic model for its components. In the latter case, the system is represented as a 
network of aggregates with fixed communication channels. As an example of system of this kind, a 
complex system of aircraft flight control of a large airport can be considered, it is as the automated 
control system with extensive and large distributed information system and with very complex 
information processing algorithms. 
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4.2. Discrete Event Models and Hybrid Systems 

Discrete event approach [41] to modeling complex systems can be used for formal description of 
both discrete and discrete-continuous (hybrid) systems. The description formalism includes 
mathematical model of system, specification language, as well as a set of procedures and functions 
that implement the simulation algorithm [42]. In contrast to the aggregative approach, the simulation 
algorithm is based on the discrete event dynamic modeling of complex systems [43-46]. 

The discrete-continuous system is a mathematical model of the form 

S = {T,P,e,E,K,F} 

where T = {tj, t £ G R > is a discrete model of time; 

P is a set of process classes; 

e is a set of event classes (the causes of instantaneous change of behavior and structure of the 
system); 

E is a set of algorithms for the event classes (preparatory discrete actions on the transition to new 
behavior of the system); 

K is a calendar of event planning; 

F is a set of equations that describe the local behavior of system processes at time intervals 
between the events. 

The calendar of event planning contains the information about the events in different objects; the 
dynamics of system is described with the help of the calendar. 

The model of calendar of event planning can be given as the tuple 

K = {{t i ,e i ),L} 

where L is a condition for occurrence of the event (planning of an event by condition, it can be 
given in the form of logical formula, predicate). 

The structure and behavior of a process is described by the mathematical model 

P = {X,Y,V s ,V d ,B} 
where X, Y are input and output channels; 

V s is a set of static process variables that are defined by algebraic expressions and can be changed 
only upon the implementation of event algorithms; 

V d is a set of functions, dynamic variables, that are defined by differential equations from F; 

B is a main body of the process that consists of the descriptions of its various behaviors. 

Modeling the behavior of discrete-continuous system means building of a set of event sequences 
leading to the change of system's behavior and structure, assuming the initial state to be an event. 
The global behavior is modeled using a special monitor process, which shifts the system time in 
accordance with the calendar of event planning or in accordance with the analysis of the occurrence 
time of the event, which is scheduled by the condition. The simulation process ends when the event 
calendar is empty. 

As we can see, the aggregative models and discrete event models use different approaches to the 
description of the same class of complex systems. As we will see, almost all the approaches to 
modeling can be considered as an extension of the basic (discrete or continuous) model, so the 
behavior of discrete-continuous system is represented in them from different point of views and from 
different, sometimes contradictory, emphases. 
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The "hybrid" line of study of discrete-continuous systems emerged in the early 90 's. A. Pnueli 
and D. Harel, the founders of hybrid approach, introduced a new class of complex systems, hybrid 
reactive systems. Investigation of the behavior of the hybrid system reduces to static qualitative 
analysis of behavioral properties, without the use of point-wise numerical simulation of the global 
system behavior. Several software tools have been developed for modeling hybrid systems, for 
example, HyTech is an automatic tool for the analysis of embedded systems. 

4.3. System Dynamics Model 

For the analysis of complex systems with nonlinear feedbacks, the principles of Forrester's 
system dynamics is used [47]. The method of system dynamics is employed for modeling systems 
from various backgrounds [48-50]. System Dynamics as a method of simulation includes the 
following stages: 

• Structuring of an object; 

• Building a system diagram of the object, where the links between the elements are specified; 

• Determining system variables for each element and the rate of their growth; 

• Adopting the hypotheses about the dependence of each rate of growth on the variables, and 
formal description of these hypotheses; 

• Evaluating process for the parameters introduced with the use of available statistics. 

To construct and study models with system dynamics method, a specialized programming 
language Dynamo that combines simulation tools and graphical notations was developed. 
The Forrester's model includes the following components: 

• Levels (resources); 

• Flows that move the content of one level to another; 

• Decision Functions that govern the rate of flow between the levels; 

• Information channels that connect the above functions with the levels. 

Levels characterize the resulting accumulations within the system. Each level is described by its 
variable that depends on the difference between the incoming and outgoing flows. The rates 
determine the instantaneous current flows between the levels in the system and model the jobs, while 
the levels measure the state, which the system reaches as a result of some job. 

Decision functions and equations of rates formulate the rules of behavior that determine how the 
available information about the levels leads to the choice of decisions related to the values of the 
current rates. The basic structure of the model, presented in Fig. 1, shows only one network with the 
elementary scheme of information links between levels and rates. However, to model the activities, 
for example, of the whole industrial enterprises, one needs to construct multiple interconnected 
networks. 
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Decision functions 



Flow channels 



Information sources 



Fig. 1: Basic structure of Forrester's model. 



There are six types of networks which represent substantially different types of variables: orders, 
materials, finances, manpower and equipment, connected together through the information network. 
Any of these networks can further be broken down into several separate parts. 

Information network serves as a connective tissue for other types of networks. It sends the 
information from the levels to the decision points, as well as the information about the rates in two 
other networks to the levels of information network. There exist levels and rates in the information 
network as well. For instance, information on the actual current rate in the flow of materials is 
averaged to determine the level of the average rate of flow of materials. This level refers to the 
information network. 

The basic structure of the model is supplemented by a system of equations, which connect the 
characteristics of the levels of this structure. Basically this system consists of the equations of two 
types: the equation of levels and the rate equation. 

When constructing the equations, the time axis is divided into intervals At^ between i-th and y'-th 
time instants. The new values of levels are calculated at the end of the interval, and they are used to 
determine the new rates (decisions) for the next interval At^ +1 . 

The level equations have the form 




where x x £ x', x 2 £ x" , x' U x" = x, x is the set of levels related to the i-th level; 

Qij is the value of i-th level at j-th time instant; 

Ar k j is the length of the interval from time instant k to time instant j; 

is the rate of input flows for i-th level at the interval between time instant k and j; 

q x ' J ' t is the rate of output flows for i-th level at the interval between time instant k and /. 
The rate equation has the form 



qf j = S k /At 



where S k is the value of level that determines the delay at time instant k; 
At is a constant, mean time, required to overcome the delay. 



Armen Bagdasaryan 



13 



The stages of building of the model are the following: 

1 . Construction of the basic structure of the model as a specialized graph; 

2. Parameterization of the graph and the construction of the corresponding system of equations; 

3. Description of the model, using a simulation language, and conducting experiments. 

The advantages of the model include: (1) the ability to reflect almost any causal relationships, (2) 
simple mathematical formulation, and (3) the use of terminology, synonymous to the concepts of the 
languages of economy, automation, and engineering. 

For the main phase variables, the so-called system levels, the following differential equations, the 
same for all variables, are used. 

dy + 
-dt =y y 

where y + is the positive rate of variable y, which includes all the factors that cause its growth; 
y~ is the negative rate of variable y, which includes all the factors that cause the decrease of y. 
These rates are supposed to be expressed in terms of the product functions that depend only on 
the so-called "factors", the auxiliary variables that are combinations of the main variables: 

y ± = g(yi,y 2 yJ = fth.h F k ) = h{F 1 )f 2 {F 2 ) ... f k {F k ) 

where Fj = Qjiy^, ...,y; m ) are factors; m = m(j) < n, k < n, n is the number of levels, that is, 
the number of factors is less than that of variables which allows one to simplify the problem and 
consider only the functions of one variable. 

The software tools that implement system dynamics models and, in particular, the model of 
Forrester are the well-known simulation environments, such as AnyLogic, VenSim, PowerSim, 
ModelMaker, etc. To construct the models they use a graphical representation of the dependent 
variables in the form of the so-called "stock and flow diagrams". 

4.4. Cellular Automata 

Cellular automata [51-53] have played a considerable role as simple models for the study of 
complex systems, and have recently been popularized by Steven Wolfram in his well-publicized 
book "A New Kind of Science" [54, 55] and by John Conway's model Game of Life. Cellular 
automata were originally invented and studied by the mathematicians Stanislaw Ulam and John von 
Neumann. Von Neumann introduced them as a biologically motivated computation models, and 
adopted cellular automata as a substrate for constructing a self-reproducing automaton [56]. 

A cellular automaton is a decentralized model providing a platform for performing complex 
computations with the help of only local information. The cellular automata paradigm of local 
information, decentralized control and universal model of computations is exploited by many 
researchers and practitioners from different fields for modeling different applied systems [57-69]. 
Cellular automata, both deterministic and stochastic, are used for modeling of various complex 
phenomena in different branches, from physical to social to engineering ones [58, 59, 68, 69]. 

The popularity of cellular automata can be explained by their simplicity, and by the enormous 
potential they hold in modeling complex systems, in spite of their simplicity. Cellular automata can 
be viewed as a simple model of a spatially extended decentralized system made up of a number of 
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individual components (cells). The communication between constituent cells is limited to local 
interaction. Each individual cell is in a specific state which changes over time depending on the 
states of its local neighbors. The overall behavior can be viewed as a simultaneous change of states 
of each individual cell. 

A cellular automaton consists of a number of cells organized in the form of a lattice. It evolves in 
discrete space and time, and can be viewed as an autonomous finite state machine. A cellular 
automaton is typically defined over a d -dimensional integer regular lattice Z d . Because of its 
inherent simplicity, the one-dimensional cellular automaton, d = 1, with two states per cell became 
the most studied variant of cellular automaton. 

More often, a cellular automaton is defined over a two-dimensional lattice such as Z 2 . Each 
lattice point (x £ , Xj) is referred to as a cell, site, or node, and is denoted by x = (x £ , x ; ). Each cell has 
a state s x (t) which often takes on its values from F 2 = {0, 1}, that is, each cell stores a discrete 
variable at time t that refers to the present state of the cell. For each cell, a notion of a neighborhood 
is defined. The neighborhood N x of a cell x is the collection of cells that can influence the future 
state of the given cell (Fig. 2). 

A common choice is the Moore neighborhood, which is the (2A + 1) x (2A + 1) square block 
centered at the cell x = (xi, Xj), where A is a positive integer parameter called the range. More 
precisely, it is the set 

N x = {y = iy'.y") = \x t -y'\ < X and \ X] -y"\ < A) 
Another choice in the two-dimensional case is the von Neumann neighborhood defined as 

N x = {y=(y',y"): \x t -y'\+ \ Xj -y"\<\} 
The neighborhood generally varies from three to five or seven cells. 

The next state of the cell at (t + 1) is affected by its state and the states of its neighbors at time t. 
Based on its current state s x (t) and the current states of the sites in its neighborhood N x , a function 
f x (called next state function, update rules, or local transition function) is used to compute the next 
state s x (t + 1) of the cell x. 

That is, we have the equation 

s x {t + l) = f x (s x {t)) 
where s x (t) denotes the set consisting of all the states s x i{t) such that x' G N x . 
The configuration s(t) of a cellular automaton is the tuple consisting of the states of all the cells. The 
above equation is used to map the configuration s(t) to s(t + 1). The cellular automaton dynamics 
or the dynamical system defined by the cellular automaton is the map O that sends s(t) to s(t + 1). 
The study of cellular automaton consists mainly in understanding its evolution, how configurations 
evolve, under the repeated iteration of the map O, so the dynamical behavior is generated and then 
can be studied. 

The local rules applied to each cell can be either identical or different. These two different 
possibilities are termed as uniform and hybrid cellular automaton respectively. 

While the next state function (local rule) in general is deterministic in nature, there are variations 
in which the rule sets are probabilistic [64, 66], or fuzzy [68, 69]. The nature of next state functions 
also varies significantly; researchers have defined the rule set according to the design requirements 
of the applications. In another type of cellular automata, the states are assumed to be a string of 
elements in a Galois field GF(q), where q is the number of states of a cellular automaton cell. 
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Square lattice Hexagonal and triangular lattices 




Stepwise change of neighborhood 
cells configuration influencing a 
central cell 

Central cell 

fj Neighborhood cells 



Fig. 2: Types of neighborhoods in cellular automata. 



4.5. Neural Networks 



The process of complex systems modeling requires a large amount of knowledge about the 
objects, including experimental, monitoring, and expert information. The last decades are witnessed 
with the wide use of neural networks to cope with large amounts of data and for processing of 
information [70-71]. Neural network based modeling has various application areas, such as pattern 
recognition, adaptive control, functional approximation, prediction, expert systems, the organization 
of associative memory, as well as study and analysis of technical and engineering systems and 
automation processes, and other applications. Each neural network consists of a collection of neurons 
(Fig. 3), which are simple elements of information transforming. 



Inputs Weights 
xi O 
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Xn Ch 



M'l 



W 2 
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Output 

-K3 y 



y = f(l) 



Fig. 3: Model of artificial neuron. 



The most well-known model of neural network is the Hop field network [72]. Hopfield networks 
were proposed as a model of associative memories. Hopfield network is a recurrent artificial neural 
network constructed from artificial neurons; it is a network of some fixed numbers of such artificial 
neurons, which are in most cases fully connected. 
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A discrete Hopfield neural network consists of an undirected graph G(V, E). At any time t, each 
node V( G V has a state Xj(t) G {+1,-1}. Each node v t G V has an associated threshold Tj G R. 



Vi is defined, which includes v t itself and the set of nodes that are adjacent to v t in G. More formally, 



States of nodes are updated as follows. At time t, node v i computes the function f t defined by 



It is assumed in many works that the underlying undirected graph is complete, that is there is an 
edge between every pair of nodes. In the definition presented above, the graph need not be complete. 
However, this does not cause any difficulties since the missing edges can be assigned weight 0. As a 
consequence, such edges will not play any role in determining the dynamics of the system. 

So, given the weights, thresholds, and the updating rule for nodes the dynamics of the network is 
defined if we determine in which order the nodes are updated. There are two ways of updating them: 
both synchronous and asynchronous update models of Hopfield networks have been considered in 
the literature. 

• Asynchronous: one fix one node, calculates the weighted input sum and updates immediately. 
This can be done in a fixed order, or nodes can be picked at random, which is called 
asynchronous random updating. 

• Synchronous: the weighted input sums of all nodes are calculated without updating the nodes. 
Then all nodes are set to their new value, according to the value of their weighted input sum. 

Neural networks are related to the class of informational models. There are several types of 
informational models based on neural networks that are presented in the literature: 

• Modeling a system in response to external action; 

• Classification of internal states of a system; 

• Prediction of dynamics of changes in a system; 

• Assessment of completeness of description of a system and determination of the comparative 
importance of system parameters; 

• Optimization of system parameters with respect to a given objective function; 

• System control. 

Typically, informational models are less expressive compared with formal mathematical models 
and expert systems by the criterion of "explicability" of granted results, but the lack of restrictions 
on the complexity of systems simulated determines their important practical significance. However, 
in some cases, neural networks and mathematical models can be combined in one model, for 
example, when external conditions are described by the equations of mathematical physics, but the 
response of a system is modeled by neural network. Sometimes, hybrid neural networks, which have 
fuzzy parameters [73-75], are used. 



Each edge \y it Vj) G E has an associated weight w £; - G R. For each node v t , the neighborhood N t of 



N t = {Vi} U {vj G V = {v it Vj) G E) 



fi(t) = sgn -T ( + 2j w ij x j(V 

where sgn is the map from R to {+1, —1}, sgn : R -> {+1, —1}, defined by 

, . f +1, if x > 
sgn(x) = \ 4 . 

( — 1, otherwise 

Now, the state of v t at time t + 1 is 

X £ (t+l)=/i(t) 
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Synthetic models, which are based on a synthesis of system components, are practically the only 
alternative modeling tools in the area of complex systems and their control, examples are sociology, 
long-term weather forecasting, macro-economy, and medicine. Recently, synthetic information 
models, which include neural networks, have become widely used in the modeling and study of 
technical, engineering, and automation systems. 

4.6. Cognitive Analysis and Cognitive Maps 

Among the control problems, the most difficult are those connected with the solution of complex 
problems. The aim of these kinds of problems is to shift the situation in a problem domain to a 
desired direction. In this case, the control object is the whole problem domain, which is regarded as a 
dynamic situation, consisting of a set of heterogeneous interacting factors. Some of these factors 
directly depend on the decisions of decision-maker (DM); other factors depend on DM only 
indirectly, while others do not depend at all and are considered as external disturbances. Dynamics of 
the situation is reflected in the fact that the situation changes with time under the influence of DM 
actions, external disturbances, and under the effects of some factors on others. 

As a rule, when solving this kind of complex problems, one evidently faces the fact that, unlike 
most of the technical and engineering systems, the control objects (i.e., situations) are both weakly- 
formalized and ill-structured: 

• The system of concepts (factors) and connections between them is not defined with sufficient 
degree of completeness; 

• The basic parameters of the situation (values of the factors, degree of influence of some 
factors on the others) are mostly not quantitative but have qualitative characteristics - 
numbers, intervals, fuzzy values, linguistic estimates that form a linearly ordered scale; 

• Non-stationarity of the processes themselves, and the variation of certain characteristics of 
the processes is often unknown, making it difficult to build their quantitative models; 

• The values of parameters of the situation, factors and connection strength are obtained mainly 
not on the basis of objective measurements but they are based on expert knowledge and 
estimates, which are subjective opinions; 

• The alternatives of how the situation will evolve cannot be formulated beforehand; they arise 
in the process of the situation analysis. 

The above features restrict the capabilities of simulation modeling, oriented on the use of 
quantitative characteristics, and of methods of traditional decision theory which relies on the 
methods of selecting the best possible alternative from a set of well-formulated alternatives. For this 
reason, these approaches became less efficient when applied to decision support and modeling in ill- 
structured problem domains. 

The modern approach to the modeling, control, and analysis of ill-structured problem domains 
and complex control problems, is based on the notion of cognitive map [76, 77], and is called 
cognitive analysis of situations. Cognitive map is a model of representation of expert knowledge 
about the situation under study. Cognitive maps are used to describe causal relationships and 
influences between factors, as well as to model the dynamics of weakly-formalized systems [78-83]. 
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Mainly, cognitive approach, based on cognitive aspects of model construction, includes the 
processes of perception, thinking, knowledge, explanation and understanding. To picture this, the 
schematic, simplified description of the world, referred to the problematic situation, is portrayed as a 
cognitive map. From the standpoint of cognitive approach the process of modeling can be divided 
into several stages as it is represented in Fig. 4. 
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Object 



Cognitive model 
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Conceptual model 
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(mathematical, physical, 
simulation model) 



Fig. 4: Generalized scheme of the process of modeling based on cognitive approach. 



The main purpose of the use of cognitive maps is a qualitative analysis and modeling of the 
dynamics of situations (tendencies, directions of changes of the values of factors, the study of 
scenarios, etc). For the purposes of quantitative analysis, the theory of differential or difference 
equations and optimal control theory is traditionally used, and in case of game-theoretic setting the 
theory of dynamic or differential games is applied (see Table 1). 



Purpose 


Modeling Method 


Qualitative analysis 


Quantitative analysis 


Description of situation 


Cognitive maps 


Differential or difference 
equations 


Analysis and control of 
situation 


Simulation modeling 


Optimal control theory 


Analysis of 
interrelationship of agents 

interested in the 
development of situation 


Cognitive games 


Dynamical games 



Table 1 : Methods for qualitative and quantitative analysis of dynamics of situations 
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F[Ai,Aj; eij) 



F\Ai,Aj", eij) 



The mathematical model of directed graph (digraph), and its extensions, underlies the notion of 
cognitive map. The mathematical model of digraph is extended to get the mathematical models of 
signed, weighted signed and functional signed digraphs. 

The model of digraph G(V, E) is extended by the components: 

• A = {Af, i < n,n = \V\}; each vertex G V is assigned a parameter A t G A; 

• F(i4, E) - a functional that determines the arcs transformation; each arc is corresponded with 
either a sign or a weight or a function. 

If the functional F has the form 

r +l, if an increase (decrease)of A t causes 
the increase (decrease)of Aj 
-1, if an increase (decrease)of A t causes 
the decrease (increase) of Aj 

then the model is called a signed digraph. 
If the functional F has the form 

r +Wij, if an increase (decrease)of A t causes 
the increase (decrease)of Aj 
-wij, if an increase (decrease)of A i causes 
the decrease (increase) of Aj 
then the model is called a weighted signed digraph; Wj ; - is called a weight of the arc. 
If the functional F has the form 

F(A it Aj; e i j)=f ij {A i ,Aj) 
then the model is called a functional signed digraph. 

The choice of concrete model depends largely on the problems of analysis to be addressed in the 
process of usage of the model. The problems of analysis of situations based on the cognitive maps 
can be divided into two types: static and dynamic. There are two kinds of models that correspond to 
these types: (1) static analysis, or analysis of influences, is the analysis of the current situation that 
involves the separation and comparison of causal chains, paths of influence of some factors on the 
others through the third ones, i.e., indirect influence. The aim of dynamic analysis is to generate and 
analyze possible development scenarios of situation in time scale. In both cases, the purpose of the 
analysis consists in the formation of possible alternative control decisions. These alternatives are the 
sets of control factors, i.e. factors, the change of which can be directly influenced by decision maker. 

When setting control problems on cognitive maps, the following concepts are often used. Control 
factors are those factors that the decision maker can change. The purpose of control is to achieve 
certain values of some selected factors, which are called the target factors. External, or input, factors 
are the factors that are not influenced by the other factors of a cognitive map. 

Analysis of influences identifies the factors with the strongest influence on target factors, that is, 
it determines the most effective points for applying control actions. Dynamic analysis considers the 
development of situation as a process of changes of its states in discrete time, and under the state of 
the situation S(t) at time t the set of values of all its factors (i4 1 (t), ... , A n (t)) at this time moment is 
understood. Dynamic analysis solves two main problems. The direct problem is a prediction of the 
situation development for a given control or external actions (change in the values of some control or 
external factors), that is, it is the computation of the sequence X(i),X(2), ...,X(ri) for a given 
change of the state X(0). The inverse problem is the calculation of control actions that result in the 



20 



Modeling, Control, and Decision Support in Complex Systems 



situation having a given state, for example, the state where the target factors have the desired value 
or some close to it. 

We can now distinguish several main directions of control of ill-structured situations on the basis 
of cognitive models: 

• Developing methods of analysis of cognitive maps and decision support techniques based on 
models of cognitive maps; 

• Developing the techniques of problem domain structuring, in other words, the methods for 
construction of cognitive maps; 

• Developing software tools and information technologies that implement the above methods. 
By interpreting the vertices, arcs and weights, and different functions that define the influence of 

connections on factors, in various ways, one can arrive at different models of cognitive maps and at 
different means of their analysis. The most common classes of models are signed digraphs, weighted 
cognitive maps, linear models, and fuzzy models. 

Signed digraphs. According to the above definitions, one considers a digraph G(V,E) and 
obtains a signed digraph if there is a function of sign: E(G) -> {—1, +1}. The weight sign +1 means 
the positive influence, the sign — 1 means negative influence. The weight of a path is the product of 
weights of its arcs; it is positive if the number of negative arcs is even, and is negative if this number 
is odd. If there are both positive and negative paths between vertices v t and Vj, then the character of 
the total influence of factor v t on factor Vj remains uncertain. The computation of influences can be 
defined as follows. 

Indirect influence l p of factor v t on factor Vj via the path P from v t to Vj is determined as 



The analysis of cycles in signed digraph is one of the problems that have to be solved in the 
process of its analysis. The positive cycle is a positive feedback loop; for example, if the factors are 
assigned some values, then an increase of the value of a factor in cycle leads to its further increase 
and then to its unbounded growth, which, in turn, leads to the loss of stability. The negative cycle 
counteracts the deviations from the initial state and contributes to stability; however, some instability 
in the form of significant fluctuations occurring during the passage of excitation along the cycle is 
still possible. Structural analysis and study of structural properties of signed digraphs, development 
of heuristic algorithms and estimations of significance of the elements of signed digraph, verification 
of weights of arcs, and estimates of preferences degree of factors are the main analytical problems in 
the area. 

The main disadvantage of signed models is the impossibility to cope with the strengths of 
influences over different arcs and paths, as well as the lack of a mechanism to resolve the 
uncertainties that arise in case of both positive and negative paths between two vertices. The basic 
approach to address them is to introduce weights that characterize the strength of influence that leads 
to the weighted signed (cognitive map), linear or fuzzy models. 

Weighted signed digraphs - deterministic cognitive map. Cognitive map (CM) is a directed 
graph (digraph) G(V, E) with vertex set V(G) and edge set E(G), which includes two functions 
F v ■ -> R and F E ■ E(G) -* R. The CM is uniquely defined by the adjacency (or weight) matrix 



lp = | j w kl 

(k,t)€E(P) 

where £"(P) is the set of arcs of the path P, and w kl is the weight (sign) of the arc e ki £ P. 
The total influence T(i,j) equals +1 if all I p > 0, and is equal to — 1 if all I p < 0. 
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W = [wy] , where n is the number of vertices and w t j is the weight of the arc e £; - G £(G); 
Wij = means that the corresponding vertices are not connected. 

The vertices C t G of CM correspond to concepts (factors) that characterize a situation (or a 
system), and the arcs define causal connections between concepts. Each concept represents a 
characteristic of the situation. In general, it can stand for events, actions, goals, values, trends of the 
situation which is modeled as a cognitive map. 

Each vertex-concept is characterized by a number A t (the function F v ) that represents its value 
and it results from the transformation of the real value of the situation's variable, for which this 
concept stands. 

Between concepts there are three possible types of causal relationships that express the type of 
influence going from one concept to the others. The weights of the arcs e t j between concept C £ and 
concept Cj (the function F E ) could be positive, w £; - > 0, which means that an increase in the value of 
concept Cj leads to the increase of the value of concept Cj, and a decrease in the value of concept C t 
leads to the decrease of the value of concept Cj; or, there could be negative causality, w i; - < 0, which 
means that an increase in the value of concept Q leads to the decrease of the value of concept Cj, and 
vice versa (Fig. 5). 

Mathematical model of CM consists of an 1 x n state vector A which includes the values of the n 
concepts and nxn weight matrix W which gathers the weights w t j of the connections between the n 
concepts of CM. The matrix W has n rows and n columns where n equals the total number of 
distinct concepts of CM and the matrix is considered to have diagonal elements equal to zero, since it 
is assumed that no concept causes itself. 




+w 43 A 4 



Fig. 5: A simple model of cognitive map. 

The value of each one concept is influenced by the values of the connected concepts with the 
appropriate weights and by its previous value. So, the value A t for each concept C t is updated by the 
following rule: 
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n 




where A t (t + 1) is the value of concept C t at time t + 1, Aj is the value of concept Cj at time t, 
Ai(t) is the value of concept Cj at time t, and Wj t is the weight of the connection between Cj and Cj, 
and / is a threshold function. 

Thus, in vector form 



So, the new state vector A t+1 is computed by multiplying the previous state vector A t by the 
weight matrix W. The new vector shows the effect of the change in the value of one concept in the 
whole CM. The above equality includes the value of each concept at previous time instants, so the 
CM possesses memory capabilities and there is smooth change after each new updating step of CM. 

Linear models. The behavior of linear models is associated with the notion of increment value 
P;(t + 1) = Ai(t + 1) — Ai(t) of the factor C £ ; the increment value in linear models is referred to as 
an impulse. The increment value is computed by the formula 



te/ 

where / is the set of all vertices from which there are paths to the vertex Vj . 

The most important characteristic of linear model is stability. The vertex v t is called pulse- 



every S. The vertex v t is called absolutely pulse-resistant if its value Ai(t) is bounded. The graph is 
called (absolutely) pulse-resistant if all its vertices are stable in the corresponding sense. The analysis 
of stability is conducted in terms of eigenvalues of the incidence matrix of the graph. It is known, 
that the graph is pulse-unstable if there exists an eigenvalue exceeding 1 1 1 ; the graph is absolutely 
stable if and only if it is pulse-resistant for every pulse process and there is no eigenvalue equal to 1 
among all its eigenvalues. 

To stabilize the unstable graphs, different methods can be used. One method is to change the 
adjacency matrix (adding or removing the arcs) of strongly connected components of the graph; 
another one is to construct an additional graph-regulator that closes, by means of feedback loops, the 
inputs and outputs of the initial graph. 

The drawback of linear models, essential for applications, consists in rigidity of these models; 
this means that it is necessary to specify the weights in the form of precise numerical values, whereas 
the main feature of ill-structured situations is impossibility to obtain the reliable numerical estimates 
of the weights. So, fuzzy models serve as the most adequate model as an alternative to linear models. 

Fuzzy models - fuzzy cognitive maps. Cognitive maps were introduced by a political scientist 
R. Axelrod [76] who used cognitive maps for representing social scientific knowledge and describing 
the methods that are used for decision making in social and political systems. Then B. Kosko [70, 
77] enhanced the power of cognitive maps considering fuzzy values for the concepts of cognitive 
map and fuzzy degrees of interrelationships between concepts. After this pioneering work, fuzzy 
cognitive maps attracted the attention of scientists in many fields and have been used in a variety of 
different scientific problems. Fuzzy cognitive maps have been used for planning and making 



A t+1 = /(A t oMO+A t 




resistant if its impulse is bounded, that is, there exists a number 5 > such that \pj(t + 1) < 8\ for 
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decisions in the field of international relations and political developments [78] and for analyzing 
graph theoretic behavior [79], been proposed as a generic system for decision analysis [80] and for 
distributed cooperative agents [81]. Fuzzy cognitive maps also have been used to analyze electrical 
circuits [82], to structure virtual worlds [83]. In the control related themes fuzzy cognitive maps have 
been used to model and support plant and manufacturing control [84, 85], to represent failure models 
and effects analysis for a system model [86, 87] and to model the supervisor of control systems [88], 
to model dynamic system control [89, 90]. It is obvious that there is high interest in the use of fuzzy 
models in a wide range of different fields. 

As with the deterministic cognitive maps, fuzzy cognitive map theory uses a symbolic 
representation for the description and modeling of system. It utilizes concepts to illustrate different 
aspects in the behavior of the system and these concepts interact with each other showing the 
dynamics of the system. A fuzzy cognitive map integrates the accumulated experience and 
knowledge on the operation of the system, as a result of the method by which it is constructed, i.e., 
using human experts that know the operation of system and its behavior in different circumstances. 

It should be mentioned that since all the values in the digraph are fuzzy, so concepts take values 
in the range between [0, 1] and the weights of the arcs are in the interval [—1, 1], or, in general, are 
the values from the linguistic scale (linearly ordered set of linguistic values that describe all possible 
strengths of influences). 

Let Cji, Cj 2 , ■■■ , Cj k be the set of all factors which are the inputs for the factor C t , i.e., they are the 
vertices of the arcs entering Cj. Then, in general case, the value of A t at time t + 1 depends on the 
values of input factors at time t and on the weights of the arcs that connect these factors with the 
factor Cf. 

A t (t + 1) = /i (t),^2(0. ...,A jk (t); w jU ,w j2fi , ...,w m ) 
The selection of the functions fa (influence functions, aggregation functions), which in general 
case can be different for different vertices, defines every concrete model. Usually, the simpler model 
is considered in applications, when these functions are the same for all factors. Such models are 
called homogeneous and to solve problems of analysis of situations within the framework of these 
models, matrix methods can be applied. 

The process of cognitive maps building precedes the work with them. Obviously, this process 
cannot be completely formalized and to large extent is subjective. On the other hand, it can be seen 
as a process of extracting knowledge from experts, and results are presented in the form of cognitive 
maps. The components of this process are the construction of the conceptual structure of the problem 
domain (identification of key factors and relationships between them), the selection of aggregation 
function, and the construction of linguistic scales (for fuzzy models) and the assignment of weights 
to the arcs. 

Cognitive maps as models of representation of expert knowledge reflect a subjective vision of 
situation. Different experts can build different cognitive maps for the same problem domain; these 
maps can differ not only by the values and signs of weights, but also by the set of factors. In this 
sense, cognitive maps can be considered as a tool of rough, qualitative description of situation. 
Cognitive models and cognitive analysis with some confidence may indicate a possible trend of the 
situation as a result of various control actions, identify the various side effects of solutions, but in 
principle cannot give guaranteed estimates and predictions. The adequacy of a cognitive model can 
be judged only by the results of its application. 
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Let us note some actual directions for further development of cognitive approach: 

• Modeling the development and control of development of dynamic situations under resource- 
limited settings; 

• Modeling of conflict situations, threats and counter threats in terms of cognitive maps; 

• Structural analysis of cognitive maps: identification of unwanted cycles, stability analysis 
(i.e., robustness - insensitivity to small perturbations) of a given situation, etc.; 

• Physical time in cognitive models; 

• Heterogeneous cognitive maps with different influence functions for different factors, and 
methods of their analysis; 

• Building techniques for cognitive maps with help of typical structures and procedures; 

• Studying the prediction reliability in cognitive models; 

• Studying the adequacy of various models of cognitive maps in different problem domains; 

• Building of space-time cognitive models, multidimensional and multilevel hierarchical 
cognitive maps and methods of their analysis. 

It should be noted that the theory of (fuzzy) cognitive maps is a powerful tool for modeling, 
analysis and control in weakly-formalized and ill-structured problem domains, as well as in domains 
with uncertainties and information incompleteness. 

The method of cognitive modeling is the method of soft modeling (simulation). The closest 
analogues of this method are simulation modeling and the method of system dynamics. The 
advantage of the method of cognitive modeling is that it can operate not only with precise 
quantitative values and formulas, but with the qualitative values and estimates as well. But this 
advantage is also can be in some sense regarded as a drawback, since the results are qualitative. 

Cognitive models help quickly get the initial results, more detailed understanding of simulated 
system, and identify regularities and then move on to more accurate models (if this is possible and 
necessary). Therefore, the most reasonable and efficient is the use of cognitive modeling at the top 
level of decision-making upon the analysis of complex socio-economic, technical, techno-economic, 
and other weakly-formalized and ill-structured systems. 

4.7. Multi-Agent Models 

Discrete, individual-based or agent-based modeling [93-95] has become a very promising and 
powerful methodology to describe the occurrence of complex behavior in diverse systems. The 
advantage of such an individual-based approach is given by the fact that it is applicable also in cases 
where only a small number of agents govern the system evolution. 

Agent-based model is the real world construed from many separate active subsystems, or units. 
Each unit interacts with other units, which constitute for him the external environment, and this unit, 
in the process of operation, may change both the external environment and its behavior. 

In agent-based modeling, a system is modeled as a collection of autonomous decision-making 
entities called agents. Each agent individually assesses its situation and makes decisions on the basis 
of a set of rules. Agents may execute various behaviors appropriate for the system they represent, for 
example, producing, consuming, or selling. Repetitive competitive interactions between agents are a 
feature of agent -based modeling, which relies on the power of computers to explore dynamics out of 
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the reach of pure mathematical methods (96, 97). At the simplest level, an agent-based model 
consists of a system of agents and the relationships between them. Even a simple agent-based model 
can exhibit complex behavior patterns and provide valuable information about the dynamics of the 
real- world system that it emulates. In addition, agents may be capable of evolving, allowing 
unanticipated behaviors to emerge. Sophisticated agent-based models sometimes incorporate neural 
networks, evolutionary algorithms, or other learning techniques to allow realistic learning and 
adaptation. 

There are many definitions of an agent. Common in all these definitions is that the agent is an 
entity that is active, with autonomous behavior, can make decisions in accordance with a certain set 
of rules, can interact with the environment and other agents, and can evolve [95, 98, 99]. 

The purpose of agent-based models is to get an overview of these global rules, the general 
behavior of the system, based on assumptions about the individual, the local behavior of its 
individual active sites and the interaction of these objects in the system. 

Multi-agent system (MAS) may be considered as an intelligent tool for the solution of such 
problems as planning, scheduling, decision making and control in the framework of production 
processes [105-106]. The MAS approach seems to be the most feasible. It respects the complicated 
characteristics of the goal that one aims to achieve. There are some significant reasons that can 
motivate one to choose the MAS approach to the solution of decision making, such as: 

• Modularity. Each agent is an autonomous module and can work without interventions of the 
external world. Each agent can have different capabilities or functionalities and through 
cooperation the agents are able to achieve a variety of goals. 

• Parallelism. The MAS approach enables to work in parallel. A complicated problem could be 
solved in an acceptable time by using a number of agents, e.g., gathering information from 
various resources allocated in different places. 

• Flexibility. The MAS approach is able to react in a flexible manner to each change in the 
environment. Through cooperation the agents can assist each other to compensate the lack of 
capability or knowledge. They can share information or own capacity to resolve a newly 
appeared situation, if one agent is not able to do so. Besides that, each intelligent agent can do 
reasoning about whom and when it has to cooperate with, in order to achieve the effective 
performance. 

It is also supposed that agents have the following properties: 

• Autonomy. Each agent, as mentioned before, thinks and acts locally. It means that agent 
operates without direct interventions from other agents to achieve its own goals. 

• Social ability. Agents can cooperate with other agents to achieve common goals. 

• Reactivity. Agents react on changes in environment; it is needed to describe the negotiation 
process. 

• Pro-activeness. Agents do more than response on events generated by environment; they can 
show goal-directed behavior. 

Generally, multi-agent systems consist of the following main components: 

• A set of system units, which is divided into two subsets, active and passive; members of the 
active subset, active units, called agents that manipulate the members from the passive subset, 
passive units called objects; 

• Environment, or space, in which agents and objects have to function and act; 
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• Tasks (functions, roles), which are assigned to agents; 

• Relations, interactions, between agents; 

• Organizational structures, configurations, which are generated by the agents; 

• Agent actions, for example, different operations over objects, communication acts. 
Interaction between agents means establishing bilateral and multilateral dynamic relations 

between the agents. Interactions between the agents have a definite direction - positive or negative, 
i.e., they have the character of assistance or resistance, attraction or repulsion, cooperation or 
competition, cooperation or conflict, coordination or subordination, etc. Interconnections and 
interdependencies between agents are characterized by certain intensity. Interactions between agents 
are dynamic. Multi-agent models are used to study decentralized systems, the dynamics of 
functioning of which is determined not by global rules and laws, but on the contrary, these global 
rules and laws are resulted from individual activity of a group of agents. Typically in such systems 
there is no global centralized management, agents operate under their own laws asynchronously. 

Agent-based models capture emergent phenomena. Emergent phenomena result from the 
interactions of individual entities. By definition, they cannot be reduced to the system's parts: the 
whole is more than the sum of its parts because of the interactions between the parts. An emergent 
phenomenon can have properties that are decoupled from the properties of the part. 

Highly flexible nature of agent-based technique allows one to apply it in many cases, especially 
when there is potential for emergent phenomena: 

• Individual behavior is nonlinear and can be characterized by thresholds, if-then rules, or 
nonlinear coupling. Describing discontinuity in individual behavior is difficult with 
differential equations; 

• Individual behavior exhibits memory, path-dependence, and hysteresis, non-markovian 
behavior, or temporal correlations, including learning and adaptation; 

• Agent interactions are heterogeneous and can generate network effects. Aggregate flow 
equations usually assume global homogeneous mixing, but the topology of the interaction 
network can lead to significant deviations from predicted aggregate behavior; 

• Averages do not work. Aggregate differential equations tend to smooth out fluctuations, not 
agent-based model, which is important because under certain conditions, fluctuations can be 
amplified: the system is linearly stable but unstable to larger perturbations. 

Or when describing the system from the perspective of its constituent units', i.e., when 

• The behavior of individuals cannot be clearly defined through aggregate transition rates; 

• Individual behavior is complex. Everything can be done with equations, in principle, but the 
complexity of differential equations increases exponentially as the complexity of behavior 
increases. Describing complex individual behavior with equations becomes intractable; 

• Activities are a more natural way of describing the system than processes; 

• Validation and calibration of the model through expert judgment is crucial. Agent-based 
model is often the most appropriate way of describing what is actually happening in the real 
world, and the experts can easily "connect" to the model, modify it and make improvements; 

• Stochasticity applies to the agents' behavior. With agent-based model, sources of randomness 
are applied to the right places as opposed to a noise term added more or less arbitrarily to an 
aggregate equation. 
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Moreover, the flexibility of agent-based models can be observed through many other aspects. For 
example, it is easy to add more agents to an agent -based model or delete agents. Agent-based models 
also provide a natural framework for tuning the complexity of the agents: behavior, degree of 
rationality, ability to learn and evolve, and rules of interactions. Another aspect is the ability to 
change levels of description and aggregation: one can easily play with aggregate agents, subgroups 
of agents, and single agents, with different levels of description coexisting in a given model. One 
may want to use agent-based modeling when the appropriate level of description or complexity is not 
known ahead of time and finding it requires some tinkering. 

Multi-agent approach allows one to investigate the problem of collective interaction, effectively 
solve prediction problems, investigate the processes of self-organization, and allow natural 
descriptions of complex systems [100, 105-107]. 

So, agent-based modeling is a powerful simulation modeling technique for studying the behavior 
and evolution of complex systems. Now, the use of the multi-agent systems paradigm for the 
modeling of complex systems has many successful applications, as it allows specialists to gather 
information quickly and process it in various ways. 

5. Hierarchical State Graph Diagrams 

The above review reveals that conventional methods in modeling and control of systems have 
contributed a lot in the research and the solution of many complex problems, but their contribution to 
the solution of the increasingly complex dynamical systems in ever changing environments will be 
limited. It has become quite clear that the requirements in the control and modeling of systems 
cannot be met with the existing conventional control theory techniques and it is necessary to use new 
methods that will exploit past experience, rely heavily on expert knowledge-bases, will have learning 
capabilities and will be supplied with intelligent simulation tools [111-119]. 

The main idea behind attempts to cope appropriately with complex problems is to describe 
relationships between various elements (objects, agents, parameters, variables, etc.) of a system and 
thus provide knowledge representation and inference. Such description of a problem should utilize 
experts' beliefs and cognition about a problem, yielding thorough analysis, reliable forecasting and 
decision-making. Problem solving planning and control in complex systems is an activity which 
deals with problems related to (optimal) selection of control actions, operations, system parameters, 
etc., required for achievement of prescribed goals. Optimality of generated solution depends 
significantly upon problem domain expert experience, beliefs, and knowledge about system behavior 
[114, 115]. 

In addition, in real world (complex) situations we face two important issues. On one side, we find 
causal and structural dependencies between system variables; on the other side, different experts 
provide different views of the same problem, build different models of situation development and 
thus propose different solutions, which in turn may perform different output and control effects. 
Modeling taxonomy based on graphical representation of situation (object, system, etc.) development 
and structural relations in concrete problem domain by means of state diagrams [120, 122] allows for 
taking into account of each possible view of a problem and thus modeling and then generate global 
model by augmenting a set of separate state diagrams [121-122]. 
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Providing a description of each object state development and then the overall complex system 
behavior, based on knowledge bases and domain experts' experience and monitoring data, state 
transition diagrams enable thorough analysis and come up with an answer to "what-if ' question. An 
"if input vector is composed of a set of control actions on lower level objects; however, our model, 
hierarchical state graph diagrams - HSGD [120-122], does not restrict us in selection of control 
objects and the input vector components can have a distributed nature and be applied at different 
levels of abstractions. What happens when an input vector affect a system, we can find as a 
hierarchical state diagram (hierarchical network) output, suggesting possible actions that steer a 
system to the desired states or bring equilibrium or stable state to the system. That is, state diagrams 
technique is mostly qualitative tool [123] but also provides some quantitative analysis of system 
development, but it cannot present exact mathematical answer but rather to point out the gross 
behavior of a system, to show the global patterns of how the whole of our hierarchical network of 
state diagrams behaves, and to get a view of what goals can be achieved by means of applying one or 
another set of control actions. 

The methodology that we propose aims to contribute to the overcoming of shortcomings of 
approaches based on traditional knowledge-based systems that lead to expert system failure related 
to, for instance, incomplete, inconsistent, and ambiguous knowledge bases. Another shortcoming that 
troubles conventional approaches to complex systems modeling is related to the type of relationships 
between system parameters and variables. These appear quite often to be rather causal and structural 
than just the only explicit "if-then" rules. Moreover, depending on a system we are modeling, its 
dynamics can additionally bring difficulties in expert knowledge base development. 

The aim of the approach is to promote the methodology for dynamic modeling, multi-criteria 
decision analysis and reasoning about potential effects of initially generated system development 
plans and related parameters with respect to control strategies. One technique for modeling systems 
which contributes to the effort for more intelligent simulation and control methods is based on the 
HSGD technique. 

5.1. Conceptual Basics of Agent Oriented Hierarchical Parametric Modeling 

We use several concepts [120, 121, 124, 125] to model complex system. They simplify complex 
problem solving in multi-parameter setting and divide it into more simple, manageable and 
understandable units. The modeling paradigm, which is the most close to our approach, uses the 
concepts of modeling complex system in agent oriented point of view. The concepts are as follows: 

• Decomposition: divides a large complex system consisting of a set of interrelated subsystems 
(objects, elements, agents) into set of small subsystems. The small subsystems can be easily 
modeled, executed and are manageable. It also divides the problem environment into a set of 
separate problem domains. By integrating (models of) small subsystems and considering 
them in each of the problem domains, we can build the large system for the whole problem 
environment. In the agent oriented view, we divide the complex system into a collection of 
sets of agents, which are studied in every specific problem domain (Fig. 6); 

• Abstraction: represents complex system into simple system conceptually. It focuses on the 
interested parts of complex system. Other detail parts are hided for simplicity. Abstract 
representation provides for qualitative description and analysis of complex system. Using 
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conceptual models that have only essential features necessary to represent or solve complex 
problem, we can understand and analyze complex system. 
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Fig. 6: Problem environment and its representation in complex system. 



• Polymorphism: introduces a set of polymorphic parameters which are applied to a collection 
of system agents. It enables one to turn from the concept of modeling and control at object 
level to the concept of modeling and control at the level of classes of objects. This helps turn 
form individual models to the integral models at arbitrary level of abstraction. 

• Hierarchy: represents the system agents, the problem and control domains and their 
qualitative characteristics, i.e., polymorphic parameters (Fig. 7, 8). The principle of hierarchy 
allows us to structure agents relations in the system and distinguish the essential interrelations 
in a system for aggregation and scaling (recount) of dependent parameters, and also helps 
structure the problem and control domain of an object; 
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Fig. 7: Principle of hierarchization: (a) flat network structure, (b) hierarchical structure. 
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• Layering: separates system functions into layers according to their roles or responsibility. 
Complex system can be represented as a layered system in which each layer plays its role. In 
general, layering concept helps understand and design complex system. 
The above concepts lead to the model scalability [121] that provides simultaneous representation 
of goals, parameters and development plans of various objects, which is very important in the 
problem of building of the models of development of large complex systems (Fig. 8). 
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Fig. 8: Generalized structure of the hierarchical decomposition of development model. 



The important features of our model are formulated as follows: 

• Model of development of each object at any level of hierarchy is sufficiently autonomous. 
This provides a sufficient degree of decomposability and therefore results in flexibility of 
building large models; 

• Objects in a system that we model, being separate units, are not modeled as such separate 
units but as classes, within each class the objects have common development goals; 

• Models of development of objects at different levels are information compatible, that is, 
outputs of one object model at some level serve as the input for another object model at some 
other levels. 

The principle of hierarchy is common in the real-world systems. There are enormous number of 
examples of it, beginning from ecosystems and biosystems to neuronal ensembles and cognitive 
networks to organizational and political systems to social and economic ones. So, the emergent 
(collective) characteristics of a particular lower level system frequently form an individual object 
(agent) at a higher level of the hierarchical system. This aspect has been emphasized by many 
researchers on artificial intelligence and complex systems [126]. 

Our model HSGD accommodates a hierarchical multilevel multi-agent dynamical system, in 
which an agent can itself be a collection of other agents. The HSGD structure is as follows: 

• HSGD is composed of a number of levels. Each level consists of a number of dynamical 
multi-agent systems which describe the behavior composed of sets of agents; 



Armen Bagdasaryan 



31 



• Each set of (n — 1) level agents is aggregated into a n level agent; 

• Behavior and goal achievement of n level agent emerges from the organization of inter-level 
dependencies and the behavior and goal achievements of 1 to n level agents. 




Aggregation/generalization Q Level i agent development diagram 



f "\ ~ , . # Level i + 1 agent development diagram 

\ y Transitions/development diagram ° r ° 

Fig. 9: Hierarchical state graph diagrams model using multi-agent multilevel dynamical system in 

nested hierarchies. 

HSGD naturally admits a description in terms of higher level and lower level, where the lower 
level is nested within the higher level. Any agent at any level is both a component of a given 
collection in its own level and a subsystem decomposable into a set of other agents at its adjacent 
lower level of HSGD (Fig. 9). Note that the agents in the lowest level are the minimum units, which 
are indecomposable of this hierarchical system. HSGD is a heterogeneous system where each set of 
agents in each level is evolved in its own goal direction and adapts to the requirements of problem 
domain environment through the application of its own development plans. The interaction topology 
of HSGD can also be heterogeneous hierarchical structures. Namely, the development rules, the 
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inter-level dependencies rules and the interaction topology of distinct sets of agents can be different, 
and these different schemes hierarchically construct the HSGD model and lead to the hierarchical 
network of dynamical processes, which properly defined leads to intelligent description of behavior. 
In mathematical terms, the HSGD model can be in generalized form defined as follows: 

HSGD = {A,D,R,L,T,0,C} 

where 

A: agents grouped in objects that lies at various hierarchical levels; 

D : dynamic systems represented as state graph diagrams that model development plans for each 
group of agents (object); 

R : coordination rules for dynamic systems at different (adjacent) hierarchical levels; 
L: the number of levels in hierarchy; 

T: the hierarchical interaction topology of HSGD given by the rules of inter-level dependencies; 
: the objects of each class in each hierarchical level; 

C: the control scenarios/strategies used for each class of objects to achieve their goals. 

Considering the problem of model building and simulation of complex system, we distinguish 
global goals lying at higher levels of hierarchy and local goals lying at the lower levels. The goals of 
objects at different levels of hierarchy are highly interconnected. Interaction between higher-level 
object and lower-level objects is such that the achievement of goals of lower-level objects 
immediately influences the achievement of goal of the higher level object. This leads to the concept 
of hierarchical state which corresponds to the global goal of higher level (Fig. 10). This means that 
each of the objects or a class of objects is immersed onto the intersection of states that correspond to 
the concrete set of the objects' goals, but the whole system is immersed into the hierarchical state. 
This approach is applicable at any level of hierarchy. 
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Fig. 10: The scheme of decomposition of a hierarchical state. 

Using the appropriate semantic interpretation, the hierarchical state shows how the current states 
of objects of different levels of hierarchy are related to each other. Our approach to the 
representation of states has the following useful properties: 

• Aggregation of parameters and therefore simplification of modeling of complex system: 

• Formalization of information gathering and its assessment for getting an integrated and 
individual estimates and global and local evaluations of the system and any level; 

• Ability to analyze the multi- and inter-level dynamics of system and study different aspects of 
inter-connected dynamic processes in a unified way. 
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5.2. Model of State Diagrams 

The main idea underlying the abstract representation of control and development processes in 
multilevel dynamic system relies on the use of model of state diagrams. State diagrams provide the 
qualitative description of dynamics of parameters and of controlled state dynamics of objects with 
use of control scenarios. The use of state diagrams technique supposes the initial classification of 
control objects over the system state space and the construction of canonical model of state dynamics 
represented by the model of state transition diagram. The state space is defined as follows (Fig. 11). 
The continuous time interval is divided into parts by means of the interval partition. On each time 
interval we have some subsets of states, in which objects remain during this interval. Every state is 
defined by the vector of values of corresponding parameters. The state of the object is thought of as a 
situation which is described by the vector of states of each agents of the object. The canonical model 
is constructed by using (1) databases containing the information about the dynamics of values of 
parameters that characterize the set of objects at a given time interval, and (2) expert knowledge-base 
consisting of declarative and procedural knowledge containing the rules of classification. 
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Fig. 11: The definition of state of an object. 



The state transition diagram (Fig. 12), in terms of which the canonical model is described, is 
defined as: 

D = ({^1 {S, S , S*},K,P + , {^,^,^,1 = Vn,n = card(S)}) 

where 

{A, 7r}: the finite time interval A divided into parts Aj by the partition n = (t ,t 1 ,t 2 , ...,T n ), 
where A ; = Tj - x^_ x and \S] =X A ; = A, n* =1 A y - = 0; 

{5,5 ,5*}: the set of states ordered by the classification rule K, S = {Sj,j = 1, n}, Sj £ S A J; more 
precisely, the rule K divides S into n equivalence classes such that we get S = {S^: j — 1, n; I = 
card(S K >)}, card{S) = m = lxn,S jl E S A J, and U] =1 S A J = S, tV} =1 S K i = 0; 

S Q , S*: the initial and final state respectively; 
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P + : the set of weighted arcs that determine state transitions, each arc is assigned the transition 
time 6; if an arc e = (Si,S;J G P + then 5 £ ■< Sj, where < is the order relation determined by K, i.e. 
there is an arc e = e t j from S t (previous state) to Sj (subsequent state); 

{fa,li > fj.*}: the distributions fa, fa, ... , fa over the vertices-states of the diagram at time moments 
tj G Aj; without loss of generally one can take tj = Tf, 

fa: is the initial distribution; 

(i*: is the final distribution. 

The canonical model is used as a tool for formalization of qualitative properties of multilevel 
dynamical system and represents hypothetical model, based on expert knowledge, of state dynamics 
of a set of objects. The canonical model describes the qualitative character of state dynamics, using 
the distributions Hi of the objects; the distributions determine the states in which the objects at some 
time Tj are. 



St 




T T-y Tj T n 



O state Tj G Aj time moment 
^. transition 

Fig. 12: The diagram of canonical model of state dynamics. 

The canonical model is then used for comparative analysis with the actual state dynamics of the 
set of objects. For this purpose, the states of the objects are consecutively re-estimated at time 
moments t £ in order to get the actual distributions of the objects over the states of canonical model, 
and then to compare this distribution with the required one. This helps represent the core essence of 
system control problems and state dynamics of control objects. The description of actual process of 
state dynamics at arbitrary time interval Aj is based on the use of states of the canonical model as 
objects' classifier. 

The state transition diagram of actual state dynamics (Fig. 13) is represented as follows: 

D a = ({£>}, P-,v(t),N(t)) 

where 

{D}: the state transition diagrams, each one extended by the components: 

P~: the set of arcs, that describes the state backstep. Thus, the set P of D a is defined as P = 
P + \JP~, P + f\P~ = 0, where P + is the set of arcs that describe state transitions; if e £; - = (5j,5,) G 
P + then (5j < Sj), but if e = (Sj, Sj) G P~ then (5j ■< Sj) and there is an arc e = e ; j from Sj 
(subsequent state) to 5 £ (previous state) orj = i; 
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t](t) = (?7 1 (t),?7 2 (t), ...,r/ v (t)): the vector-function called the counter of objects, v = card(P); 
each component rj k (t) of the vector determines the number of objects that change their state from 5 £ 
to Sj, k ■= (Si,Sj), at some time interval Aj; the counters rj k {t) are assigned to each arc e t j = 
(Si,Sj) £ P; The counters assigned to the arcs P + characterize the intensity of objects' state 
transitions (positive processes); the counters assigned to the arcs P~ estimate the intensity of objects' 
state backsteps (negative processes); 

JV(t) = (JVHO.N 2 ^), iV n (t)): the vector function, each component of which iV'(t) defines 
the number of objects having a fixed state S t ,n = card (5). 
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Fig. 13: The diagram of actual state dynamics. 

The functions rj(t) and iV(t) allow us to obtain the information on the relation between processes 
of development and degradation, and to qualitatively estimate control actions and their efficiency. 

5.3. Coordination of State Diagrams and Their Compositions 

Coordination [134-142] is one of the key issues in the modeling, control and design of complex 
systems, and has been the subject of numerous investigations in areas such as sociology, economics 
and organizational theory. From an engineering point of view, coordination is conceived as a means 
to integrate various activities or processes in such a way that the resulting ensemble shows desired 
characteristics and functionalities. The design of coordination mechanisms is particularly challenging 
in the field of multi-agent systems, as they are usually embedded in highly dynamic environments, 
and neither the number nor the behavior of agents can be directly controlled at design time. We argue 
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that additional high-level abstractions need to be integrated into agent oriented design methodologies 
in order to exploit the full potential of coordination schemes, and to engineer coordinated multi-agent 
system in open environments in an efficient manner. 

Maybe the most widely accepted conceptualization of coordination in the multi-agent field 
originates from work in the area of organizational science [143] that defines coordination as the 
management of dependencies between organizational activities. It is straightforward to generalize 
this approach to coordination problems in multi-agent systems. The subjects whose activities need to 
be coordinated are the processes in agents. However, the entities between which dependencies arise 
(or object of coordination) and should be coordinated are usually come down to goals, actions and 
plans. Depending on the characteristics of the system environment, taxonomy of dependencies can 
be established, and a set of potential coordination rules are assigned [144]. Within this model, the 
process of coordination is to accomplish two major tasks: establishing the dependencies in the 
system, and then, decision respecting which coordination rules must be applied. The coordination 
mechanism is the way to perform these tasks [145]. 

We put the problem of coordination within the context of state transition diagrams that model the 
state dynamics of agents. 

We introduce several compositional operations giving the rules of consistency of different state 
diagrams. These rules help one to construct complex models of state dynamics that combine the 
interrelations between different sets of parameters and represent the conditions for coordination of 
state dynamics for objects at different levels of hierarchy. Structural composition of state diagrams 
provides a synthesis of complex requirements set to the dynamical characteristics of controllable 
object. The structural composition of simple models is one of the key issues in building the complex 
models of hierarchical state dynamics. 

So, we say that for state diagrams the property of consistency holds if the attainability of certain 
states takes place in prescribed time-event sequence. The operations of sequential and parallel 
compositions and operation of aggregation are introduced. 

Let D 1 and D 2 be two state diagrams given at time intervals A x = [0, a-J and A 2 = [0, a 2 ] 
correspondingly. Then the operations of compositions for the diagrams are as follows: 

a) Sequential composition 

The diagrams D 1 and D 2 are sequentially composed, that is, they compose a linear fragment if 
for their time intervals one has a x < a 2 (Fig. 14) 

b) Parallel composition 

The diagrams D 1 and D 2 are composed in parallel, that is, they compose a parallel fragment if 
they are defined on the same interval, a x = a 2 (Fig. 14) 

c) Aggregation 

The aggregation is defined for state diagrams at different levels of hierarchy. In this case, for 
coordination of state diagrams at neighbor levels of hierarchy the Cartesian product of states 
of diagrams of lower level of hierarchy is defined (Fig. 15). To do this, one should specify the 
ordering relation on the subsets of Cartesian product of states of diagrams of lower level of 
hierarchy. 

The above defined compositions are straightforwardly generalized for arbitrary number of state 
diagrams. 

Combining the above two compositions, we get a sequential-parallel composition when the time 
intervals at which the state diagrams are given has an intersection. The operation of aggregation can 



Armen Bagdasaryan 



37 



be defined not only on the single states, but also on the subgraphs of the state diagrams of lower level 
of hierarchy. 
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Fig. 14: Sequential (a) and parallel (b) compositions of state diagrams. 




S x = {l,2,3}x{I,II} 
S 2 = {4,5,6} x {III, IV, V} 
Si<S 2 

Fig. 15: Aggregation of state diagrams - children dynamical systems (i), parent dynamical 
system (i + 1). 



The composition of state diagrams allows one to formally represent different combinations of 
complex criteria sets in order to perform objects classification and to solve control problems. Using 
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the consistency rules and operations with state diagrams one can model diverse schemes of inter- 
level relations and influence of states of lower level diagrams on the processes at higher levels of 
hierarchy. As a result, certain value is produced at the output of the highest level; this value is 
considered as a response of the hierarchical system on the input control symbols. 

5.4. Model of Controllable Development of System 

Elementary and complex state diagrams enable one to construct clear and graphic development 
models. The nodes of diagrams are states, and the arcs are intensities of objects transitions from one 
state to another. The ordering of states demonstrates the process of objects development. Using the 
modeling tools, the development model can be redefined and new states and new ordering relations 
can be given. Considering the state diagrams in time domain (time-domain analysis) - animation of 
objects' flows - allows forming the time characteristics of the process of development of a set of 
objects under study. 

The various approaches to the control processes require consideration of development models, in 
which the representation of controllable dynamics of hierarchical object initiated by input signals 
comes to the forefront. The model of controllable development is based on the following principles: 

• selecting the control actions that influence the controllable system; this is important for 
autonomous construction of control scenario and for flexible modification of the model to the 
alternative control scenarios; 

• taking into account the states that have been attained on the previous control stages (system 
state history); this provides a succession of multistage control scenarios; 

• comparing with the results of alternative control scenarios; this provides basic arguments 
upon assessment of the efficiency of control scenarios. 

The model of controllable development illustrates the key dynamic characteristics depending on 
whether or not the control actions corresponding to the current states are performed. In this sense, the 
model of controllable development is constructed in the form of "what if hypothesis. 

A hypothesis of controllable development is defined as the tuple 

H = (S,P,S 0l S*,X,T) 

where 

S: the set of states; 

S , S*: the initial and final states respectively; 
X: the set of input control symbols; 

P: the set of arcs, P = P + U P~ , P + n P~ = 0; P + is a subset of arcs that define state transitions 
initiated by input control symbols, P~ is a subset of arcs that define state backsteps when neither of 
control symbols enter the input; 

X <-» P + : the one-to-one correspondence that defines for each input control symbol the state 
transition initiated by this symbol; 

To model and analyze the interconnection between state diagrams at different levels of hierarchy 
we introduce to the model the rules of inter-level dependencies. This rules can be considered as a 
kind of win/loss scheme that formally describes what one agents (objects) can obtain (benefit, profit), 
depending on the states of other agents. So, 
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T: the inter-level connection rule between state transitions at neighbor levels of hierarchy. The 
rule is determined by the mechanism of after-effect by means of splitting P + and X into two subsets 
(P Z + ,P U + ) and (X Z ,X U ), respectively. The arcs of P z + are called isolated, and the arcs of P u + are called 
coupled. According to this partition, control symbols of X z are called individual, and control symbols 
of X u are called general. The coupled arcs are defined by introducing the parent-arcs as a Cartesian 
product of child-arcs for state transition diagrams at neighbor levels of hierarchy. The isolated arcs 
P z + describe the state transitions initiated by individual input symbols X z ; this kind of symbols do not 
influence the state transitions of other diagrams. The coupled arcs P u + describe the state transitions 
initiated by general input symbols X u ; this kind of symbols initiate the state transition on the parent- 
arc, which means, as a consequence, the initiation of state transitions on the corresponding child- 
arcs. And conversely, state transitions on all/several child-arcs initiate a state transition on the parent- 
arc of the diagram of the higher level of hierarchy. 

The model of control scenario that manages the development of objects in complex hierarchical 
system is represented as 

C = <Sl,l,F,d,T) 

where 

H: the set of state transition diagrams that describe the state dynamics - development plans - for 
each object; 

/: the hierarchical structure identifier; in general, the identifier is related with the topology of the 
system; this is done by extending the model of control scenario by some variable 6 that will define 
the system topology and, as a consequence, the structural relations in the system, for example, 
hierarchical structure, networked structure, etc.; 

F : I -» fl: the functional that assigns the hierarchical number to each diagram from fi; 

i9: the time diagram for control symbols X; it determines the sequential-parallel process of input 
control symbols entering; 

T: the scheme of after-effect given by the inter-level connection rule between state transitions. 

The time diagram i9 can be given by the use of different ways, including the estimation rules of 
each current state of the system. 

The trajectory of attainable states represents general and local goals solved by control scenario on 
arbitrary time interval. Several properties can be considered to evaluate the quality and efficiency of 
scenario: 

• scenario is called to be complete if all subsystems move to the final states of the 
corresponding state diagrams; 

• scenario is redundant if both individual and general symbols, which are coupled in the 
"parent-child" hierarchy of state diagrams, enter the input of subsystem; 

• scenario with omitted possibilities exhibits high frequency of transitions on the arcs that stand 
for the backsteps of the states already reached; 

• complexness of scenario is estimated by frequency of transitions on coupled arcs. 
Generally, the study of basic properties of control scenario is based on the analysis of the 

trajectory of attainable states and its comparison with the expected or predicted effect. 
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5.5. Dynamic Classification of Control Objects 

In section 5.2. we pointed out that when constructing the canonical model the rules of 
classification are used. Indeed, the use of hierarchical state diagrams technique supposes the initial 
classification of control objects over the system state space in order to build the canonical model of 
state dynamics of a set of objects under study. The rules of classification are represented in the form 
of matrices with production rules as elements, which are the formulas of some language L. An 
element (ij) of classification matrix, where i is a parameter and j is a class of objects, contains a 
formula that determines the current process of dynamics of i-th parameter changes at time interval. 
The matrices of this type give rules of one-level classification. However, the rules of multilevel 
classification are more important in hierarchical models. Multilevel classification is based on the 
gradual specification of conditions that should be satisfied by objects from a class. In general case, 
the rules of multilevel classification are heuristic, and reflect the knowledge and experience of 
problem domain experts. The subclass of multilevel classification rules which along with the 
grouping of objects reflect the semantics of state dynamics is of the most interest. To define 
multilevel classification, the notions of state scale and classifier are introduced. 

Let K = {k 1 ,k 2 , ...,k q }, q < card(set of parameters), be a set of predicates related to the 
values of parameters of a set of objects. Then the ordered set of propositions K = {K t < K 2 < ■■• < 
K n }, n < card(S), T K .r\T K . = 0, i j, where T Kl is the truth domain of K h is called a one-level 

scale if each K t defines the state S t . It is assumed that propositions and the corresponding states have 
the same ordering, that is, if K t < K 2 < ••• < K n then S 1 < S 2 < ■•• < S n . The scale determines the 
values of parameters and allows one to compare the states of the objects. 

The scale {K tl < K iz < ••• < K in ] is said to be the hierarchical continuation of the scale {K x < 

K 2 < ••• < K t < ••• < K n ] if the propositions {K iv , v = 1, n} are the set of sub-propositions of K t . 

The hierarchical system of scales is referred to as classifier for a set of objects over the set of 
parameters at time interval A. The classifier is then used for formal description of state dynamics of 
the objects from the set. The classification of objects over the states allows us to get the state space 
of the system. 

5.6. General Algorithm for Construction of System Development Model and its Analysis 

We outline a general algorithm for construction of development model for objects at one level of 
hierarchy. The algorithm is a basic algorithmic process for building the development model of 
complex hierarchical system with polymorphic parameters. 

Let us denote by W the set of objects of one level of hierarchy. The algorithm is divided into four 
stages. 

Stage 1: includes the preliminary study; at this stage one should establish the parameters which 
dynamics goes in parallel and which characterize an object from W. At first stage we choose the set 
of parameters and draw the graph representation of their parallel dynamics at a given time interval. 
Using a graph representation we compare the character of parameter value changes of the object. 

Stage 2: the stage of estimation of dynamics of the parameters; it consists in getting the 
comparative dynamical characteristics of polymorphic parameters for different objects from W, and 
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in extrapolating the dynamics of parameter values for arbitrary object with simple relationships, 
which describe the essence of processes that are now studied. The analysis of parameter dynamics 
gives answers to the following questions: whether a parameter is a function of time of any standard 
type - monotone increasing or decreasing, with one or several critical points, whether the function is 
bounded, whether it has a point of inflexion, or it can be described by a cyclic process. 

Stage 3: the stage of recognition of the type of dynamic processes; it consists in estimation of 
states of parameter dynamics. This includes heuristic analysis of a sequence of parameter values 
X{X), X(T), X(3), ... at discrete time moments, which then produces the estimate of the current state 
at arbitrary time moment t, 5(t) = F(5(t — 1), X{t — l),X(t)), where F is a function, S(t — 1) and 
X(t — 1) are respectively the state and the value of parameters at previous time moment (t — 1). 
This heuristic process is universal and applicable for every parameter, for which values the operation 
of comparison is defined. A qualitative estimation of the current process of dynamics of the 
parameters allows one to create diverse classification rules K. 

Stage 4: at this stage the classifier determined by the classification rules K is used for formal 
description of dynamic development model of objects from W . Formally, the description of the 
dynamical system is given in the form of canonical model of development of objects from W. 

Canonical models along with the actual state dynamics allows one to get a qualitative picture of 
the development processes of the dynamical system under study. 

These four stages of the algorithm comprise the general scheme of study of a set of objects at 
arbitrary level of hierarchy as a unified dynamical system. 

5.7. Criteria for Efficiency of Control Scenarios 

One can see that the method of HSGD formalizes the state dynamics processes in the form of 
mathematical mappings. In a generalized form, the model of system development and hierarchical 
control can be represented as follows. 

Let Uij be a set of control actions for i/-th subsystem, c Uy be a subset that corresponds to 
the k-th state, and let A be the control time interval and u(i,j, t) G Uu the control action on y-th 
subsystem at time t G A. Then the control process is formally described by the vector-function 

u(i,j,t) = (u 1 (i,j,t),u 2 (i,j,t),...,u n {i,j,t)) 
in control space II?=i U j of Cartesian product of sets of control actions on different subsystems. It is 
assumed that u(i,j, t) has a unique influence on subsystem state and on the value of its efficiency 
criterion. 

Then, let s(i,j,t) be the process of state changes, and w(i,j,t) be the process of changes of 
efficiency criterion for 17-th subsystem at control time interval A, t G A. Then, the vector-functions 

s(i,j,t) = (s 1 (i,j,t) l s 2 (i,j,t),...,s n (i,j,t)) 

and 

w(i,),t) = (w 1 (i,j,t),w 2 (i,j,t),...,w n (i,j,t)) 
formally describe the attainable configurations that represent the efficiency of control process it(t) at 
time instant t G A. 

The above vector-functions can be used to define the concrete efficiency criteria in accordance to 
the needs of simulation and priorities of decision-maker. 
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5.8. Modeling System States and Process of Analysis 

The tool of state diagrams and HSGD method enables one to describe the process of 
development of complex system in highly information-intensive environments. This information 
(problem) environment is broken down into a collection of problem domains which represent the 
information levels of the system. Each information level consists of a number of information 
contexts. The concept of information context allows one to combine in one model a large amount of 
diverse information of different character (Fig. 16). This allows one to explore the model in different 
aspects and, based on the knowledge obtained by simulation, to synthesize a holistic view on the 
system. Based on the agent oriented model of the system and object oriented approach to the control 
and problem domains, each information level describes the system as a discrete-continuous dynamic 
multilevel model, which reflects the process of state changes of the system in the phase space. 
Discrete properties of each of the information levels of the system are determined by the necessity to 
divide the state space of each of the objects into subspaces in order to reflect the observations that 
characterize the change of states of the objects upon transition from one subspace to another. Our 
approach uses a combination of analytical and empirical relations with the methods and means of 
artificial intelligence, where the available analytical and empirical relations are supplemented by 
formalized or weakly-formalized expert knowledge. 




Problem environment 
(industrial enterprise) 



Fig. 16: The demonstration of dividing of problem environment into information levels and 
information contexts: problems environment - enterprise, problem domains (information levels) - 
financial department, scientific & production department, etc., information contexts - economic 
planning division, accounting division, R&D division, production plants, etc. Other problem areas, 
for example, ecological systems, social and economic systems, technical systems, are broken down 
into information levels and contexts in the same manner. 



Armen Bagdasaryan 



43 



The state transitions are described by the information-mathematical model provided by the 
combination of data and knowledge stored in databases, knowledge bases, in the existing ontologies 
and mathematical modules. The subspaces of states are defined by means of the classifier. Using the 
selected information levels and contexts and the subspaces of states, the overall process of modeling 
system states and its analysis is formally presented as follows: 

M = (A,S,X,Mn, U,Y,V,V y ,Q) 

where 

Ac R: the finite time interval of system modeling; 

S: the state space; 5 = (5 1 ,5 2 , ...,s n ), where Sj is the phase coordinate. Each Sj can be bounded 
from both sides, s £ < Sj < s~l, s £ and si are the restrictions on the values of phase coordinates, 

i = 1, n; s(t) is the phase trajectory of state changes. The phase coordinates describe the properties 
and states of the system on different information levels. The set of phase coordinates has an object- 
oriented structure, that is, s £ = (s £l ,Sj 2 , ...,s ir ), each coordinate is described by a collection of its 
own properties - factors. The phase space S is represented as a partition n^i^-' that corresponds to 
the hierarchical structure of state changes and incorporates the notion of hierarchical state, k is the 
number of nesting hierarchy level. 

X: the set of admissible inputs, x = [x^x 2 , ...,x l ], I is the number of inputs, each input accepts 
information of its type that corresponds to the information contexts; 

Mn: the set of output results m of monitoring and/or diagnosing of control object, m = 
[m^m 2 : , ...,m p ]. 

U: the set of control actions, u = \v},u 2 , ...,u q ]. The control action is determined by the 
causality "current state - control action", needed to steer the objects to the desired state with 
prescribed values of parameters; control actions can be formalized by means of production rules. 

Y: the set of output information that characterize the values of parameters that define the states of 
objects, y = [y 1 ,y 2 , — ,y h ]. 

V = (Yx, V m , V u , V h , Im, Pr): the transition operator that defines the set of current states, based on 
the results of the previous modeling step (prehistory), with some priority value p G Pr, that is, 
(s w (t),p w ) = K(s(t — 1), t,p), where w = 1, W, W is the number of current states under study; V x 
is the operator of synthesis of new initial conditions and new states that depends on the input 
information, V m is the operator of generation of information on the results of monitoring and/or 
diagnosing, V u is the operator of formation of the control actions, V h is the operator of formation of 
information from lower level of hierarchy, it uses the inter-level connection rules T - the mechanism 
of after-effect; Im — {Db, Kb, Ma, 0, PR, p} is the information-mathematical model that describes 
the behavior and state dynamics of objects between the events, Db - the databases, Kb - the 
knowledge-bases, Ma - the analytical models of state dynamics of objects at time intervals, - the 
ontologies of problem domains (information levels), PR - production rules constructed by experts 
and based on Db and Kb, which give rules for re-estimation of current states around the dynamics of 
parameters and serve for possible generation of new states; p is the priority of the behavior of state 
dynamics of the objects, which characterized by expert knowledge and decision-maker; 

V y : the output operator, y(t) = V y (s(t — 1), t), that transforms the information on the state of the 
object to the values of parameters to be controlled on the next step; 
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Q : the qualitative characteristic of the system state; it is determined by the combination of expert 
estimates of this state and the profit of reaching this state - what goals are achieved; it depends on 
the priorities p of the previous states. 

The possibilities provided by the information-mathematical model and its analysis are the tool for 
decision support. The simulation process on the above models allows one to predict the changes in 
values of parameters over all problem domains of the system and predict future system states, and 
thus justify the decisions to be made. 

Finally, we would like to outline some directions for further development of HSGD tool: 

• Developing probabilistic model of HSGD and methods of its analysis; 

• Describing HSGD components and dynamics by means of mathematical functions (operators) 
to get rigorous mathematical analysis of the model; 

• Studying HSGD as hierarchical dynamical network, using mathematical methods and means 
of dynamical systems theory; 

• Describing HSGD in hierarchical game-theoretic setting and developing the methods of its 
analysis; 

• Modeling and control of conflict situations with conflict goals at different hierarchy levels; 

• Modeling and control of system development under resource- and time-limited settings (or, 
some other interested criteria), using methods of optimal control theory; 

• Building heterogeneous and distributed space-time HSGD models; 

• Structural graph-theoretic analysis of HSGD: identification of unwanted cycles, stability 
analysis, robustness of given situations, etc.; 

• Applying HSGD for modeling and solving software engineering problems, and in some other 
areas, for example, social sciences, etc. 

Some improvements, extensions, or new variables and functions may be included in the current 
model of HSGD to get an adequate model for the above directions. 

6. Intelligent Information System for Simulation and Decision Support 

Computer information system intended for large scale simulations and decision support should 
inevitably be based on the comprehensive use of information technologies [146, 147]. The system 
should have a modular structure that provides sufficient convenience and facility of editing of the 
separate modules, not influencing the functioning of the others, and adding of new functional 
capabilities. If it is possible for application domain, the system should be built in the form of master- 
system that could be able to dynamic tuning to the specific problem domain, and in order the 
information environment of the system could be adapted to the current range of problems. 

6.1. Characteristics of Intelligent Simulation Environment 

Computer simulation models that provide intelligent simulation environment within the 
information system should meet the following main requirements: 
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• Model completeness. The models should provide sufficient possibilities for obtaining the 
necessary characteristics of system with the required accuracy, reliability, and confidence; 

• Model flexibility. The models should enable one to reproduce various situations upon 
changing of system parameters; 

• Model structure. The models should provide the possibility of modification of their separate 
parts; 

• Information support. It should provide the information compatibility of models with 
computer databases. 

An intelligent simulation environment is a large knowledge-based integration system, which 
consist of several symbolic reasoning systems (LISP, PROLOG, etc.) and numerical simulation 
software. Such environments suggest a framework for integration of numerical simulation, expert 
system and artificial intelligence techniques. In a goal-oriented environment, once the system is 
described and the goals specified, the simulation system drives itself to goal achievement. Several 
studies show the applications of intelligent simulation in the area of production systems. We propose 
intelligent simulation environment of various control strategies and scenario modeling. Recently, an 
integrated knowledge-based model is developed for complex man-machine systems [148]. Intelligent 
simulation environments are also proposed for flexible manufacturing systems, information systems, 
process plants, etc. [149-152]. In our approach, an intelligent modeling environment is a flexible, 
integrated, and knowledge-based framework capable of extending, learning and correcting itself. It is 
goal oriented and searches for the best solutions by referring to desired target. 

In parametric modeling and analysis, the knowledge of values of various parameters and their 
dynamics is one of the most important elements that provides adequate representation and modeling 
of state dynamics of complex systems. Monitoring schemes allows one to carry out the observation 
for the current values of parameters and for the actual information on the character of system 
parameter dynamics. This information is then used to evaluate conditions/situations around system 
and to predict possible events in the system and consequences following from them, which can be 
caused by changes in values of parameters. 

Intelligent simulation environment is proposed by integration of: 1) an integrated database and 
modeling, 2) rule -based (goal-oriented) behavior and 3) parametric and flexible structures. It is a 
goal oriented, flexible and integrated approach and produces the optimum solution by referring to an 
integrated models and knowledge- and databases. The properties and modules of the prescribed 
intelligent simulation environment are: 1) parametric modeling, 2) flexibility, 3) integrated modeling, 
4) rule-based module, 5) integrated knowledge- and databases and 6) learning module. 

Generally, the information on the problem domain and properties of system is contained in 
specialized databases; knowledge about parameters and processes is contained in knowledge bases; 
information about the current values of parameters and on the character of state dynamics of object is 
contained in monitoring databases. The investigations on the models are provided by the 
combination of the methods of (1) dynamic knowledge-based expert systems, (2) production expert 
systems, (3) database processing techniques, (4) monitoring/ diagnostic data analysis, (5) scenario 
control and modeling. 
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6.2. Characteristics of Decision Support System 

A decision support system (DSS) is an information system that supports decision-making and 
system management activities [154-156]. A properly-designed DSS is an interactive software-based 
system intended to help decision makers in compiling useful information from raw data, documents, 
personal knowledge, business models, etc., to identify and solve problems and make decisions. A 
DSS enables the user to make fast, responsive decisions using all the necessary information 
appropriate to the task at hand. 

According to [156], a basic DSS framework contains a database and model base, with associated 
management systems, and a dialog component through which the decision maker interacts. Other 
features include graphical-based dialog interface (a graphical user interface, GUI), output facilities 
and report generators, and event logging. In [147] authors describe these three components in more 
detail. The Data Management Component stores information (which can be further subdivided into 
that derived from an organization's traditional data repositories, from external sources, or from the 
personal insights and experiences of individual users); the Model Management Component handles 
representations of events, facts, or situations (using various kinds of models, two examples being 
optimization models and goal-seeking models); and the User Interface Management Component is, 
of course, the component that allows a user to interact with the system. In [157] author analyzes a 
number of works and names the following components as essential for a modern DSS: (1) models, 
which include multi-criteria techniques, problem-solving schemes, data processing and knowledge 
management; (2) analytical and numerical methods of data pre-processing and identification of 
problems for the preliminary stages of decision making; (3) human-computer interaction and its 
organization through graphic interface and others; (4) information support, communication with 
databases, web-services, etc. According to [154], academics and practitioners have discussed 
building DSS in terms of four major components: (a) the user interface, (b) the database, (c) the 
modeling and analytical tools, and (d) the DSS architecture and network. The definition of a DSS, 
based on [154] and [157], in that a DSS is a system to support and improve decision making, 
represents, in our opinion, an optimal and suitable to our needs background for information DSS 
requirements. The traditional decision making workflow consists of several standard steps (Fig. 17). 

The DSS structure has to satisfy the requirements, imposed by specialists, and characteristics and 
restrictions of the application domain. The decision making process includes the preparatory period, 
situations simulation, analysis of influence of control scenarios, the development of decisions and, 
finally, the decision making itself and its realization. 
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Background 
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Stating the 
general goal and 
the sub-goals 
2 



Creating 
evaluation system 
for the situation 
assessment - 3 



Analysis of the 
situation and 
diagnostic 
4 



Forecasting 
of situation 
dynamics 
5 



Generating 
alternatives of 
situation 
development - 6 



Selecting the main 
variants of control 
influence 
7 



Working out 
scenarios of 
situation 
development - 8 



Selecting the optimal scenario 
9 



Fig. 17: The traditional scheme of decision-making. 



As a rule, characteristics of successful DSS experiences include: assistance in semi-structured 
decision tasks, support of managerial judgment, useful to non-computer specialists working 
interactively with the system, exploits both models and databases to generate information, and adapts 
to the decision-making approach of the user. A DSS does not necessarily look for optimal solutions 
to complex and/or operational problems, but rather as Ackoff [158] states, a DSS supports "a 
decision for which adequate models can be constructed but from which optimal solutions cannot be 
extracted". The levels of automation and support to the decision maker can vary from high to low. 
Strong [159] found that high levels of decision automation and high levels of decision support 
provided a best DSS environment to support decision makers. 



6.3. Architecture of Intelligent Information System 

The architecture of information system consists of several independent but logically related to 
each other subsystems [127, 128]. The subsystem of Direct Planning is intended to establish 
complex problem points, to cope with a collection of interconnected complex control problems, to 
construct control scenarios for solving complex problems and to compare them in accordance to the 
efficiency criteria. The subsystem includes the following components (Fig. 18): 

• User interface provides interaction of user with the system. The software of user interface 
serves as a tool that realizes all functions of computer system associated with information 
exchange with the user; 

• Library of parameters contains blocks of parameters for supporting the continuous process of 
observing for a number of parameters; the library is extendable and editable. 

• Dynamic Knowledge-based Expert System is a computer realization of formalized expert 
knowledge about problem and control domains, and it is used in building dynamic models. 
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Builder of canonical model of state dynamics is a specialized module of entering of state 
diagrams as input information. The state diagrams tool provides clear and precise 
formalization of states, inherent for one process and not typical for others. It can be used for 
representation of regularities and typical models of state dynamics. 

Monitoring databases. Direct planning in control systems assumes a high level of 
informatization and operative connection with monitoring database. 

Interpreter of monitoring database. The interpreter of monitoring database and the model of 
controllable state dynamics are the basic components in automated computer information 
system. The interpreter of monitoring database functions according to the composition of 
canonical models of state dynamics specified by the user and generates the description of 
actual multilevel dynamics of the object. 

Model of controllable state dynamics is constructed as expert subsystem for qualitative 
estimation of control scenarios defined by the user. 
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Fig. 18: A structure of direct planning subsystem. 



Some explanation should be given for the component Dynamic Knowledge-based Expert System. 
We wish to note that one of the approaches to the synthesis of dynamic models of complex systems 
is based on the use of the so-called master-systems consisting of canonical templates and expert 
knowledge-bases. The knowledge-base consisting of declarative and procedural knowledge realizes a 
conceptual model of complex system. The declarative knowledge contains: 

• Objectives tree of complex system that provides a decomposition of global goal on subgoals 
and description of relation between them; 

• The architecture and/or structure of complex system; 

• The set of canonical templates; 

• The set of models of canonical templates; 

• Problem domain databases. 

The information about objectives tree can be represented as the tuple 
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= (J.Id.G.D) 

where / is a structure that determines a decomposition of global goal, Id is the structural 
identifier for nodes, G is a goal assigned to the node, L is a rule/law that describes the connection 
between the neighbor nodes. 

The canonical template can be realized with the use of the language of system dynamics [47] or 
state transition diagrams. The canonical template has a certain structure, a set of input, output, and 
initial values/conditions. Formally the canonical template can be described as 

C = (Str,T,X,Y, U.Iv.Tr) 

where Str is the structure of the template, T is a rule/law of template functioning/behavior, X is a 
set of input parameters, Y is a set of output parameters, U is a set of control symbols, Iv is a set if 
initial values/conditions, Tr is a set of rules that govern the transformation of template structure, 
which means adding, modifying, removing links and/or nodes. 

The canonical template is a separate object having information about its components and certain 
internal structure. The canonical template model is the object containing information not only about 
its components and structure but also the concrete input and output values and values of initial 
conditions. Each canonical model is assigned to one of the goals of the objectives tree. 

The synthesis of dynamic models of complex system is realized by transformation of declarative 
knowledge about problem domain to the algorithms of system state dynamics with the help of 
procedural knowledge. 

The procedural knowledge is realized in knowledge-bases in the form of inference rules. They 
formalize the process of dynamic models synthesis. The inference rules provide the mapping of 
structure of conceptual model into the structure of dynamic models. The knowledge-base can contain 
different groups of inference procedures, depending on the purposes of investigation. For example, 
they can be of the following types: correspondence rules that determine for each canonical model the 
goal problems it solves; the inference rules that define informational relations between the templates 
in canonical model, etc. 

The representation of conceptual model of complex system in the form of knowledge-bases 
provides the autonomous usage of expert knowledge upon synthesizing the dynamic models. The 
above model is extended by adding to the canonical templates a set of input control symbols, thus 
providing the dynamic models with the mechanism of system control. 

So, the Dynamic Knowledge-based Expert System is constructed in the form of master-system, it 
dynamically tunes to the specific problem domain requested by the user through the Interface, 
provides corresponding templates for synthesis of models, connects with the appropriate database, 
and provides the relevant to the selected problems knowledge-base. 

The subsystem of Direct Planning realizes the two stage process of simulation and control (Fig. 
19). The first stage is the stage of retrospective analysis consisting in the construction of predictive 
model of inertial state dynamics, which is the model of dynamics of object when no control actions 
are undertaken. The retrospective analysis provides the means for event prediction. When predicting 
events, the parameters of system are being continuously measured. If there was some event in a 
system and for some time before the event a parameter has sharply changed, or there was a gradual 
change of values of parameter up to some critical, then such anomaly is related with this event. The 
dependencies of such a kind confirmed repeatedly, becoming stable, are used for estimation and 
prediction of possible future events in the system. Actually, knowledge and experiences obtained in 
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the past and expert knowledge are used. The stage of retrospective analysis provides user with the 
tools of selection of objects, study of chosen parameters, and construction of state diagram, which 
interprets the monitoring data. This implements the diagnostic analysis of objects' state dynamics. 
By analysis, experimentation, and selection of different sets of parameters, the diagrams that most 
expressively depict "negative" (positive) trends are found. These diagrams formally represent the 
current control problems and answer the question "what will be if no control actions are performed". 
The results of retrospective analysis help put forward the goals and control problems and help one to 
form possible alternatives of controllable state dynamics for the perspective period. 

The second stage consists in construction of the model of controllable state dynamics which 
includes statement of control problem, alternative control scenarios, expert estimation and selection 
of control scenarios of object's state dynamics. The stage includes the construction of the model of 
controllable state dynamics, analysis of controllable processes of objects' state dynamics, and 
obtaining the answer to the question "what control actions should be undertaken to achieve the 
required goals". At this stage an initial state and expected final state are described and the space of 
intermediate states are constructed. Then, the conceptual model of control scenario in the form of 
States Generator is defined. 



Stage 1. Retrospective analysis 



Predictive Model of Inertial Dynamics 



Stage 2. Direct Model of Controllable State Dynamics 



Statement of Control Problem 



Alternative Control Scenarios 



Statement of Control Problem 



Fig. 19: Generalized scheme of the process of direct planning. 

The subsystem of Multilevel Dynamics Simulation includes the components (Fig. 20): 

• System of canonical models of state dynamics of hierarchical object provides the necessary 
tools for construction of canonical state dynamics models of simulated objects. 

• Scheme of coordination of canonical models is based on the rules of composition of state 
diagrams. 

• Description of actual state dynamics of hierarchical object uses the monitoring databases that 
store the information on the actual dynamics of parameters. 
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• Monitoring databases contain the current information about the dynamics of parameters, 
which is the result of monitoring or diagnosing of the object. 

• Partial/incomplete canonical model of state dynamics. The model of controllable state 
dynamics is used for checking a hypothesis about the efficiency of scenario being estimated. 
The scenario estimation criterion is given in the form of "partial" or "incomplete" state 
dynamics diagram determining support states that should be reached with the specified 
restrictions on time and resources. 

The special case of "partial/incomplete" state dynamics diagram is the pair of states: initial state 
and desirable final state. In this case, the expert subsystem should: either confirm a hypothesis that 
the model of state dynamics, controlled on the basis of scenario, meets the given criteria or 
requirements, and supplement the input diagram with the specifying intermediate states, or refute the 
hypothesis and generate computer prediction in the form of alternative state dynamics diagram. 

• Scenarios of state dynamics/Conceptual model of scenarios - States Generator. The Scenarios 
of State Dynamics serves as an inference system. It is considered as generator of consecutive 
states of object under investigation. The rules of States Generator are represented in the 
format of tree-like decomposition of global goal on the sub-goals; to each terminal node an 
elementary rule is assigned. The rules are represented in the IF-THEN format (Fig. 21): 

(Sj, S k , S h u ik , r ik , t ik ) 

where u ik is the control action needed to be undertaken for an object to be steered from the 
state Si to the state S k with the use of resources r ik and in time t ik , while not admitting the 
backstep to the previous state S t . 
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Fig. 20: Structure of multilevel dynamics simulation subsystem. 



The construction of scenarios is divided into several steps: (1) analysis of initial state of object 
and of possible trends of state's changes, (2) exploration of a spectrum of possible future states of the 
object, (3) formulation of hypotheses about tendencies in transitions from those states to the 
subsequent ones, (4) analysis and formulation of desired end results - final state of the object. 
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r ik> tik 




Fig. 21: The format of elementary IF-THEN rule. 

The subsystem of Simulation Process Control includes two modules (Fig. 22), Executive Module 
and Control Module: 

• Executive Module consists of database of objects' control models, database of state dynamics 
simulation models, database of analyzable control actions, simulation system of controlling 
scenarios, and database of complex control actions. Simulation system of controlling 
scenarios that uses the database of objects' control models, the database of state dynamics 
simulation models, and the database of analyzable control actions provides a tool for formal 
representation of goals, control problems and state dynamics, time and resource 
characteristics. 

The simulation system of controlling scenarios enables user to analyze global efficiency 
of control actions directed on the achievement of goals at different levels of hierarchy. The 
system allows user to not just compare separate control actions but also to formally 
synthesize complex control actions (control strategies) for hierarchical system as a whole, 
and then provides their further comparison. The functional sub-modules of Executive Module 
reproduce the stages of control actions selection, including the stage of automatic synthesis 
and initiation of problem domain and control models. 

• Control Module realizes the functions of expert estimation and comparison of control action 
sets, knowledge-base support, and decision making. 

The simulation process control subsystem provides the tools of synthesis, simulation, and 
analysis of control scenarios. 
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Fig. 22: Structure of simulation process control subsystem. 



The rules of state transformations and the scheme of construction of control scenarios: (1) allows 
one to easily realize iterative process of creation and modification of control scenarios, (2) admit the 
efficient realization by means of executive procedure, (3) possess the sufficient expressiveness of 
specification of control processes. 

The State Generator enables user: (1) to study effects of integrated and multi-aspect control 
regarding different objects of complex system, (2) to divide the control process into stages, (3) to 
perform decomposition schemes of prediction, in which each subsequent model is an integrated or 
detailed elaboration of the previous, (4) to construct and analyze the interconnected aggregated and 
detailed models of state dynamics of the system. 

The flexibility and comprehensiveness of the architecture of information system provides the 
implementation of the following functions: 

• Identification and registration of the information about the events and the current situation 
around the complex system. Information and expert knowledge storage, maintaining and 
management; 

• Description of system parameters and those of monitoring and/or diagnosing; 

• Description of control actions; 

• Description of information-mathematical model; 

• Description of the structure of state space; 

• Description of the structure of control and problem domains and informational levels of 
system dynamic models. 

The overall architecture of computer information system for simulation and decision support is 
presented on Fig. 23. 
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Fig. 23: General architecture of information system. 



The general scheme of the process of system simulation analysis and decision making based on 
the model of HSGD with use of the methodology of hierarchical system scenario control and control 
strategies consists of five interconnected levels (Fig. 24). 

The computer information system allows user: 

• To define global goal of complex system and to represent a decomposition on the subgoals, 
and to describe relations between them; 

• To synthesize dynamic models of complex system; 

• To determine efficient control actions in solving control problems and achieving system 
goals; 

• To realize the iterative process of creation and modification of control scenarios; 

• To study multi-aspect control of different subsystems and analyze integrative behavior of 
complex dynamic system as a whole; 

• To construct and analyze different control scenarios, study and compare them for efficiency; 

• To study behavior of system under different initial conditions and to study state dynamics of 
system for different groups of parameters; 

• To get a holistic view on a complex system and its behavior; 

• To make integrated and well-founded decisions. 
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Fig. 24: The general scheme of system simulation analysis and decision making. 



The proposed architecture provides the most complete tools of simulation and decision support in 
relation to the problems and goals that were outlined in the beginning of this section. This 
information system is quite suitable for applications in weakly-formalized and ill-structured problem 
domains. It enables one to: 

• involve modelers and decision-makers in the process of formalization of criteria for scenarios 
evaluating; 

• provide users with the ability to put the current tasks of problem analysis in a language close 
to the professional; 

• provide the possibility of considering the problem with various degrees of specification, 
using operational data of the level requested; 

• provide users with the possibility to conduct long-term computer archives of statistical and 
monitoring data of specific applied models of systems; 

• accumulate knowledge about the problem and control domain, build and use the information 
system, open to correction and supplementation; 
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• use expert knowledge about the quantitative and qualitative assessments of interrelationships 
between dynamic system parameters. 

The system enables to conduct the analysis of significance of control scenarios in relation to the 
complex problem solving and provides the ability to integrate it with the actual process of planning, 
control, and decision making. 

7. Conclusions 

To adequately model and analyze processes in complex real-world systems, we need the holistic 
and integrative methods that combine in them both top-down and bottom-up approaches. It is often 
not necessary to cope with the all available system parameters and functions in order to get a good 
approximation of modeled system. Even simpler models lead to very complex behaviors and allow 
us to obtain sufficiently detailed and comprehensive understanding of processes in the system. 
Although it is true for physical and biological systems, for many other kinds of systems, like social, 
cognitive, engineering, business-process, some systems of artificial intelligence, and others, we have 
to take into account as much system interrelations, processes, dependencies as it possible. This can 
only be done by first using methods of systems analysis, and then one needs techniques that have 
been developed in the field of systems theory and control sciences. 

In this chapter we have discussed the problems of modeling, control and decision support in 
complex systems from the viewpoint of systems theoretic approaches and methods. We considered 
the basic characteristics of complex systems and analyzed system theoretic approach to complex 
systems study. We have also considered the main frameworks and paradigms of modern system 
modeling and control and analyzed the most widely used methods for mathematical modeling and 
simulation of complex dynamic systems. 

We have proposed the general dynamic modeling technique for complex hierarchical systems 
consisting of many objects functioning in control loop. The generalized algorithmic schemes for 
analysis of the proposed models are also presented. The proposed technique uses the object-oriented 
multi-agent paradigm, and is based on the information-mathematical models and described in terms 
of the hierarchical state transition diagrams. The method allows both qualitative and quantitative 
analysis of system behavior and state dynamics through hierarchical scenario calculus. For 
evaluation of different scenarios the efficiency criteria related to the control strategies are presented. 
We also proposed a general structure of computer information system for simulation and analysis of 
dynamic processes, control strategies and development scenarios in complex systems, which can be 
used in decision making process. 

The technique presented can also be used as a technology for designing and building of 
information systems for simulation analysis of development strategies and control scenarios of 
complex objects, and has been applied in several information systems and decision support systems. 

The models proposed are especially powerful in information-intensive environments. The 
information can be simultaneously aggregated in several directions: by hierarchical structure of 
processes and states embedding, by parallel representation of dynamical characteristics of several 
processes within one state, and by dividing the observation time interval in accordance to the events 
associated with the state changes in dynamics of system. The proposed models and technique are 
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sufficiently universal and at the same time it is problem-oriented. The technique can be equally used 
for various kinds of systems such as technical, engineering, organizational, socio-economic, strategic 
planning, long-term forecasting systems, and decision support systems. 
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